Sep 11 22:54:53 devstack cinder-volume[76663]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 22:54:53 devstack cinder-volume[76663]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 22:54:53 devstack cinder-volume[76663]: we strongly recommend against using it for new projects.
Sep 11 22:54:53 devstack cinder-volume[76663]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 22:54:53 devstack cinder-volume[76663]: framework.  For more detail see
Sep 11 22:54:53 devstack cinder-volume[76663]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 22:54:53 devstack cinder-volume[76663]:   import eventlet  # noqa
Sep 11 22:54:55 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:54:55 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:54:55 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:54:57 devstack cinder-volume[76663]: INFO dbcounter [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Registered counter for database cinder
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG oslo_db.sqlalchemy.engines [None req-bb25be5e-b66a-484a-818f-01447840776f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG dbcounter [-] [76663] Writer thread running {{(pid=76663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:54:57 devstack cinder-volume[76663]: INFO cinder.rpc [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 22:54:57 devstack cinder-volume[76663]: INFO cinder.rpc [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG oslo_db.sqlalchemy.engines [None req-bb25be5e-b66a-484a-818f-01447840776f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:54:57 devstack cinder-volume[76663]: INFO cinder.volume.manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Determined volume DB was empty at startup.
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG cinder.volume.manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76663) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 22:54:57 devstack cinder-volume[76663]: INFO cinder.volume.manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 11 22:54:57 devstack cinder-volume[76663]: WARNING stevedore.named [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 22:54:57 devstack cinder-volume[76663]: WARNING castellan.key_manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:54:57 devstack cinder-volume[76663]: WARNING cinder.keymgr.conf_key_mgr [None req-bb25be5e-b66a-484a-818f-01447840776f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG cinder.volume.drivers.lvm [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76663) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 11 22:54:57 devstack cinder-volume[76663]: DEBUG oslo_concurrency.processutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_concurrency.processutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] CMD "cinder-rtstool verify" returned: 0 in 0.456s {{(pid=76663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_db.sqlalchemy.engines [None req-bb25be5e-b66a-484a-818f-01447840776f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:54:58 devstack cinder-volume[76663]: INFO cinder.rpc [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 11 22:54:58 devstack cinder-volume[76663]: INFO cinder.rpc [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 11 22:54:58 devstack cinder-volume[76663]: WARNING stevedore.named [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 22:54:58 devstack cinder-volume[76663]: WARNING castellan.key_manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:54:58 devstack cinder-volume[76663]: INFO cinder.volume.manager [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_db.sqlalchemy.engines [None req-bb25be5e-b66a-484a-818f-01447840776f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:54:58 devstack cinder-volume[76663]: INFO oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Starting 1 workers
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Started child 76822 {{(pid=76663) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Full set of CONF: {{(pid=76663) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] ******************************************************************************** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Configuration options gathered from: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] ================================================================================ {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] allow_availability_zone_fallback = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] allow_compression_on_image_upload = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] allowed_direct_url_schemes     = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] api_rate_limit                 = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] auth_strategy                  = keystone {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] az_cache_duration              = 3600 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_availability_zone      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_host                   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_name                   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_stats_polling_interval = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backup_api_class               = cinder.backup.api.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backup_name_template           = backup-%s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backup_use_same_host           = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backup_use_temp_snapshot       = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] chap_password                  = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] chap_username                  =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_internal_tenant_project_id = e97de514a3c147b892b5418d67d2c3fb {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_internal_tenant_user_id = 8389fe0c358e4106ab9db4a4bca527d2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cloned_volume_same_az          = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cluster                        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] compression_format             = gzip {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] compute_api_class              = cinder.compute.nova.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] config_dir                     = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] config_source                  = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] control_exchange               = openstack {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] debug                          = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] default_availability_zone      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] default_group_type             = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] default_volume_type            = lvmdriver-1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] disk_geometry                  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_client_cert             = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_client_cert_key         = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_data_namespace          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_ssl_cert_path           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_ssl_cert_verify         = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] driver_use_ssl                 = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] enable_force_upload            = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] enable_new_services            = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] enable_unsupported_driver      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76822]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] enforce_multipath_for_image_xfer = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] filter_function                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_api_insecure            = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_api_ssl_compression     = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_ca_certificates_file    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_catalog_info            = image:glance:publicURL {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_certfile                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_keyfile                 = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_num_retries             = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance_request_timeout         = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] goodness_function              = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] graceful_shutdown_timeout      = 5 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] group_api_class                = cinder.group.api.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] host                           = devstack {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_compress_on_upload       = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_conversion_address_space_limit = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_conversion_cpu_limit     = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_conversion_disable       = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_introspection_address_space_limit = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_introspection_cpu_limit  = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_upload_use_cinder_backend = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_upload_use_internal_tenant = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_volume_cache_enabled     = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_volume_cache_max_count   = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] image_volume_cache_max_size_gb = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] init_host_max_objects_retrieval = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] instance_format                = [instance: %(uuid)s]  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iscsi_target_flags             =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iscsi_write_cache              = on {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iser_helper                    = tgtadm {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iser_ip_address                = 192.168.122.19 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iser_port                      = 3260 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_color                      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_config_append              = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_dir                        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_file                       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_options                    = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_rotate_interval            = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_rotate_interval_type       = days {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] log_rotation_type              = none {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] max_age                        = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] max_logfile_count              = 30 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] max_logfile_size_mb            = 200 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] max_over_subscription_ratio    = 20.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] message_reap_interval          = 86400 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] message_ttl                    = 2592000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] migration_create_volume_timeout_secs = 300 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] monkey_patch                   = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] monkey_patch_modules           = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] my_ip                          = 192.168.122.19 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] no_snapshot_gb_quota           = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] num_iser_scan_tries            = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] num_shell_tries                = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] num_volume_device_scan_tries   = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] nvmeof_conn_info_version       = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] nvmet_ns_id                    = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] nvmet_port_id                  = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_max_limit                = 1000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_ext_list          = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_listen_port       = 8776 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_use_ssl           = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] osapi_volume_workers           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] per_volume_size_limit          = -1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] periodic_fuzzy_delay           = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] periodic_interval              = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] public_endpoint                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] publish_errors                 = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_backup_gigabytes         = 1000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_backups                  = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_gigabytes                = 1000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_groups                   = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_snapshots                = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] quota_volumes                  = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] rate_limit_burst               = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] rate_limit_except_level        = CRITICAL {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] rate_limit_interval            = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] reinit_driver_count            = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] replication_device             = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] report_discard_supported       = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] report_interval                = 120 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] reservation_clean_interval     = 86400 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] reservation_expire             = 86400 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] reserved_image_namespaces      = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] reserved_percentage            = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] rpc_response_timeout           = 120 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] run_external_periodic_tasks    = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] scst_target_driver             = iscsi {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] scst_target_iqn_name           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_down_time              = 720 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] shell_completion               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] snapshot_name_template         = snapshot-%s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] snapshot_same_host             = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] split_loggers                  = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] state_path                     = /opt/stack/data/cinder {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] storage_availability_zone      = nova {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] storage_protocol               = iSCSI {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] syslog_log_facility            = LOG_USER {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_helper                  = lioadm {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_ip_address              = 192.168.122.19 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_port                    = 3260 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_protocol                = iscsi {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] target_secondary_ip_addresses  = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] trace_flags                    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] transport_url                  = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] until_refresh                  = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_chap_auth                  = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_default_quota_class        = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_journal                    = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_json                       = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_multipath_for_image_xfer   = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_stderr                     = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] use_syslog                     = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] verify_glance_signatures       = enabled {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_api_class               = cinder.volume.api.API {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_backend_name            = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_clear                   = zero {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_clear_ionice            = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_clear_size              = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_copy_bps_limit          = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_dd_blocksize            = 1M {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_name_template           = volume-%s {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_service_inithost_offload = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volume_usage_audit_period      = month {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] zoning_mode                    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_concurrency.disable_process_locking = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.auth_section = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.auth_type   = password {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.auth_version = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.cache       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.certfile    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.include_service_catalog = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.insecure    = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.interface   = public {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.keyfile     = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_password = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcache_username = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.region_name = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.service_type = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.backend                  = dogpile.cache.null {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.backend_argument         = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.backend_expiration_time  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.config_prefix            = cache.oslo {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.debug_cache_backend      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: INFO cinder.volume.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.enable_retry_client      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.enable_socket_keepalive  = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.enabled                  = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.expiration_time          = 600 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.hashclient_retry_attempts = 2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_dead_retry      = 300 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_pool_maxsize    = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_sasl_enabled    = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.password                 = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.proxies                  = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.redis_db                 = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.redis_server             = localhost:6379 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.retry_attempts           = 2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.retry_delay              = 0.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.socket_keepalive_count   = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.socket_keepalive_idle    = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.socket_keepalive_interval = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.socket_timeout           = 1.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.tls_allowed_ciphers      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.tls_cafile               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.tls_certfile             = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.tls_enabled              = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.tls_keyfile              = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cache.username                 = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] coordination.backend_url       = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.asyncio_connection    = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.asyncio_slave_connection = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.backend               = sqlalchemy {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.connection            = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.connection_debug      = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.connection_parameters =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.connection_recycle_time = 3600 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.connection_trace      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.db_inc_retry_interval = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.db_max_retries        = 20 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.db_max_retry_interval = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.db_retry_interval     = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.max_overflow          = 50 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.max_pool_size         = 5 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.max_retries           = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.mysql_wsrep_sync_wait = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.pool_timeout          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.retry_interval        = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.slave_connection      = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.sqlite_synchronous    = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.synchronous_reader    = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] database.use_db_reconnect      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_tracing.insecure = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.connection_string     = messaging:// {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.enabled               = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.es_doc_type           = notification {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.es_scroll_size        = 10000 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.es_scroll_time        = 2m {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.filter_error_trace    = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.hmac_keys             = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.sentinel_service_name = mymaster {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.socket_timeout        = 0.1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.trace_requests        = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler.trace_sqlalchemy      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler_jaeger.process_tags   = {} {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler_jaeger.service_name_prefix = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] profiler_otlp.service_name_prefix = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.enforce_new_defaults = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.policy_default_rule = default {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.policy_file        = policy.yaml {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.group          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.helper_command = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] privsep_osbrick.user           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.group         = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.helper_command = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] cinder_sys_admin.user          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.auth_section      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.auth_type         = password {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.cafile            = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.certfile          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.collect_timing    = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.insecure          = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.keyfile           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.send_service_user_token = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.split_loggers     = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.timeout           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.tls_ciphers       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] service_user.tls_min_version   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.auth_section            = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.auth_type               = password {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.certfile                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.collect_timing          = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.insecure                = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.keyfile                 = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.region_name             = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.split_loggers           = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.timeout                 = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.tls_ciphers             = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] glance.tls_min_version         = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.backend_availability_zone = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.chap_password = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.chap_username =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.062s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.disk_geometry = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_client_cert = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_client_cert_key = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_data_namespace = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.driver_use_ssl = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.extra_capabilities = {} {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.filter_function = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.goodness_function = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iscsi_target_flags =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iscsi_write_cache = on {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iser_helper   = tgtadm {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iser_port     = 3260 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.lvm_share_target = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.lvm_type      = auto {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.num_shell_tries = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.replication_device = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.report_discard_supported = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.reserved_percentage = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_helper = tgtadm {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_port   = 3260 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_protocol = iscsi {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.trace_flags   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.unique_fqdn_network = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.use_chap_auth = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_backend_name = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_clear  = zero {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_clear_ionice = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_clear_size = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_reports.file_event_handler = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_reports.log_dir           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.backend_host       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.chap_password      = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.chap_username      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.disk_geometry      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_client_cert = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.extra_capabilities = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.filter_function    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.goodness_function  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iser_helper        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iser_ip_address    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iser_port          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.lvm_share_target   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.lvm_type           = auto {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.num_shell_tries    = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.replication_device = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.report_discard_supported = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.reserved_percentage = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.scst_target_driver = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.storage_protocol   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_helper      = lioadm {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_ip_address  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_port        = 3260 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.trace_flags        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.use_chap_auth      = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_clear       = zero {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_clear_size  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] lvmdriver-1.volumes_dir        = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl      = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_notifications.driver = [] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_notifications.retry = -1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] key_manager.fixed_key          = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.barbican_api_version  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.barbican_endpoint     = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.barbican_endpoint_type = public {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.barbican_region_name  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.cafile                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.certfile              = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.collect_timing        = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.insecure              = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.keyfile               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.number_of_retries     = 60 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.retry_delay           = 1 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.send_service_user_token = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.split_loggers         = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.timeout               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.tls_ciphers           = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.tls_min_version       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.verify_ssl            = True {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican.verify_ssl_path       = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.auth_section = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.auth_type = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.cafile   = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.certfile = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.collect_timing = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.insecure = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.keyfile  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.split_loggers = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.timeout  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.tls_ciphers = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] barbican_service_user.tls_min_version = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.approle_role_id          = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.approle_secret_id        = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.auth_method              = approle {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.auth_path                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.kv_mountpoint            = secret {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.kv_path                  = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.kv_version               = 2 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.namespace                = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.root_token_id            = **** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.ssl_ca_crt_file          = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.timeout                  = 60.0 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.token_file               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.token_role               = None {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.use_ssl                  = False {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:54:58 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] ******************************************************************************** {{(pid=76663) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:58 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:58 devstack sudo[76875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 11 22:54:58 devstack sudo[76875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:54:59 devstack sudo[76875]: pam_unix(sudo:session): session closed for user root
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:59 devstack sudo[76991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:54:59 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:54:59 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.290s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 22:54:59 devstack cinder-volume[76822]: INFO cinder.brick.local_dev.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:59 devstack sudo[77083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:54:59 devstack sudo[77083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:54:59 devstack sudo[77083]: pam_unix(sudo:session): session closed for user root
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG cinder.brick.local_dev.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76822) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 11 22:54:59 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:54:59 devstack sudo[77166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:54:59 devstack sudo[77166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:00 devstack sudo[77166]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.527s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:00 devstack sudo[77435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:00 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:00 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.355s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:00 devstack sudo[77678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 11 22:55:00 devstack sudo[77678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:00 devstack sudo[77678]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.308s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:00 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:00 devstack sudo[77815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:55:00 devstack sudo[77815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:01 devstack sudo[77815]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:01 devstack sudo[77852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:55:01 devstack sudo[77852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:01 devstack sudo[77852]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:01 devstack sudo[77861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:01 devstack sudo[77861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:01 devstack sudo[77861]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:01 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:01 devstack sudo[77944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:01 devstack sudo[77944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:02 devstack sudo[77944]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack sudo[77957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:02 devstack sudo[77957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:02 devstack sudo[77957]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: INFO cinder.volume.drivers.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack sudo[77961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:02 devstack sudo[77961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:02 devstack sudo[77961]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.292s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack sudo[77966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:55:02 devstack sudo[77966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:02 devstack sudo[77966]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:02 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:02 devstack sudo[77969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:02 devstack sudo[77969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:03 devstack sudo[77969]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:03 devstack sudo[77972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:03 devstack sudo[77972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:03 devstack sudo[77972]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:03 devstack sudo[77975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:03 devstack sudo[77975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:03 devstack sudo[77975]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:03 devstack cinder-volume[76822]: INFO cinder.volume.driver [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG cinder.volume.driver [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76822) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_db.sqlalchemy.engines [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writer thread running {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG cinder.db.api [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Building query based on filter {{(pid=76822) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG cinder.image.image_utils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76822) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 11 22:55:03 devstack cinder-volume[76822]: INFO cinder.keymgr.migration [None req-8b79ee60-389a-4fa1-92e4-3dd364cb73da None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:55:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:03 devstack sudo[77979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:55:03 devstack sudo[77979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:04 devstack sudo[77979]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:04 devstack sudo[77983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:04 devstack sudo[77983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:04 devstack sudo[77983]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:04 devstack sudo[77988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:04 devstack sudo[77988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:04 devstack sudo[77988]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:04 devstack sudo[77991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:04 devstack sudo[77991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:04 devstack sudo[77991]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:04 devstack cinder-volume[76822]: DEBUG cinder.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Notifying Schedulers of capabilities ... {{(pid=76822) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:55:05 devstack cinder-volume[76822]: INFO cinder.volume.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Driver initialization completed successfully.
Sep 11 22:55:05 devstack cinder-volume[76822]: INFO cinder.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Initiating service 2 cleanup
Sep 11 22:55:05 devstack cinder-volume[76822]: INFO cinder.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Service 2 cleanup completed.
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG cinder.service [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Creating RPC server for service cinder-volume {{(pid=76822) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG cinder.service [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76822) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 22:55:05 devstack cinder-volume[76822]: INFO cinder.volume.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:05 devstack sudo[77996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:55:05 devstack sudo[77996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:05 devstack sudo[77996]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:05 devstack sudo[77999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:05 devstack sudo[77999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:05 devstack sudo[77999]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:05 devstack sudo[78005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:55:05 devstack sudo[78005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:05 devstack sudo[78005]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:05 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:55:05 devstack sudo[78008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:55:05 devstack sudo[78008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:55:06 devstack sudo[78008]: pam_unix(sudo:session): session closed for user root
Sep 11 22:55:06 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:55:06 devstack cinder-volume[76822]: INFO cinder.volume.manager [None req-62b642f5-bb0d-427c-9ec1-604841bf0547 None None] Driver post RPC initialization completed successfully.
Sep 11 22:55:08 devstack cinder-volume[76663]: DEBUG dbcounter [-] [76663] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:55:15 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:55:16 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:56:03 devstack sudo[80098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:56:03 devstack sudo[80098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:56:03 devstack sudo[80098]: pam_unix(sudo:session): session closed for user root
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:56:03 devstack sudo[80101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:56:03 devstack sudo[80101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:56:03 devstack sudo[80101]: pam_unix(sudo:session): session closed for user root
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:56:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:56:03 devstack sudo[80104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:56:03 devstack sudo[80104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:56:04 devstack sudo[80104]: pam_unix(sudo:session): session closed for user root
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:56:04 devstack sudo[80107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:56:04 devstack sudo[80107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:56:04 devstack sudo[80107]: pam_unix(sudo:session): session closed for user root
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG cinder.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Notifying Schedulers of capabilities ... {{(pid=76822) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread count: 6 {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 22:56:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread info: [<_MainThread(MainThread, started 136122470064256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136122365114176)>, <Thread(Thread-3 (stat_writer), started daemon 136122355814976)>, <Thread(Rabbit-heartbeat, started daemon 136122355689600)>, <Thread(Thread-5 (_runner), started daemon 136122355205632)>, <Thread(Thread-7 (_runner), started daemon 136122353292288)>] {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:57:03 devstack sudo[83397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:57:03 devstack sudo[83397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:57:03 devstack sudo[83397]: pam_unix(sudo:session): session closed for user root
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:57:03 devstack sudo[83400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:57:03 devstack sudo[83400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:57:03 devstack sudo[83400]: pam_unix(sudo:session): session closed for user root
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:57:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:57:03 devstack sudo[83410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:57:03 devstack sudo[83410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:57:04 devstack sudo[83410]: pam_unix(sudo:session): session closed for user root
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:57:04 devstack sudo[83413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:57:04 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:57:04 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG cinder.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Notifying Schedulers of capabilities ... {{(pid=76822) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread count: 6 {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 22:57:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread info: [<_MainThread(MainThread, started 136122470064256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136122365114176)>, <Thread(Thread-3 (stat_writer), started daemon 136122355814976)>, <Thread(Rabbit-heartbeat, started daemon 136122355689600)>, <Thread(Thread-5 (_runner), started daemon 136122355205632)>, <Thread(Thread-7 (_runner), started daemon 136122353292288)>] {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 22:57:16 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:SELECT=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:57:16 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:UPDATE=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:58:03 devstack sudo[85404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:58:03 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:58:03 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:58:03 devstack sudo[85413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:58:03 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:58:03 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:58:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:58:03 devstack sudo[85420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:58:03 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:58:04 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root
Sep 11 22:58:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:58:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:58:04 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:58:04 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:58:04 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Sep 11 22:58:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:58:04 devstack cinder-volume[76822]: DEBUG cinder.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Notifying Schedulers of capabilities ... {{(pid=76822) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG cinder.volume.drivers.lvm [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Updating volume stats {{(pid=76822) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:03 devstack sudo[86618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 11 22:59:03 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:03 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:03 devstack sudo[86629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:59:03 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:03 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:03 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:03 devstack sudo[86657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 11 22:59:03 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:04 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:04 devstack sudo[86688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 11 22:59:04 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:04 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG oslo_concurrency.processutils [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76822) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG cinder.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Notifying Schedulers of capabilities ... {{(pid=76822) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG oslo_service.periodic_task [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] Running periodic task VolumeManager._thread_info {{(pid=76822) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread count: 6 {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 22:59:04 devstack cinder-volume[76822]: DEBUG cinder.volume.manager [None req-01ef5016-6762-4698-86a2-cf30977a1cf6 None None] thread info: [<_MainThread(MainThread, started 136122470064256)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136122365114176)>, <Thread(Thread-3 (stat_writer), started daemon 136122355814976)>, <Thread(Rabbit-heartbeat, started daemon 136122355689600)>, <Thread(Thread-5 (_runner), started daemon 136122355205632)>, <Thread(Thread-7 (_runner), started daemon 136122353292288)>] {{(pid=76822) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 22:59:16 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:SELECT=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:59:16 devstack cinder-volume[76822]: DEBUG dbcounter [-] [76822] Writing DB stats cinder:UPDATE=1 {{(pid=76822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:59:25 devstack cinder-volume[76663]: INFO oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Caught SIGTERM, stopping children
Sep 11 22:59:25 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Acquiring lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:25 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Acquired lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:25 devstack cinder-volume[76663]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Releasing lock "singleton_lock" {{(pid=76663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:25 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Stop services. {{(pid=76663) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 11 22:59:25 devstack cinder-volume[76663]: DEBUG oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Killing children. {{(pid=76663) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 11 22:59:25 devstack cinder-volume[76663]: INFO oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Waiting on 1 children to exit
Sep 11 22:59:30 devstack cinder-volume[76822]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Acquiring lock "singleton_lock" {{(pid=76822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:30 devstack cinder-volume[76822]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Acquired lock "singleton_lock" {{(pid=76822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:30 devstack cinder-volume[76822]: DEBUG oslo_concurrency.lockutils [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Releasing lock "singleton_lock" {{(pid=76822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:30 devstack cinder-volume[76822]: WARNING amqp [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 22:59:30 devstack cinder-volume[76822]: WARNING amqp [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 22:59:30 devstack cinder-volume[76663]: INFO oslo_service.backend._eventlet.service [None req-bb25be5e-b66a-484a-818f-01447840776f None None] Child 76822 exited with status 0
Sep 11 22:59:30 devstack cinder-volume[87228]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 22:59:30 devstack cinder-volume[87228]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 22:59:30 devstack cinder-volume[87228]: we strongly recommend against using it for new projects.
Sep 11 22:59:30 devstack cinder-volume[87228]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 22:59:30 devstack cinder-volume[87228]: framework.  For more detail see
Sep 11 22:59:30 devstack cinder-volume[87228]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 22:59:30 devstack cinder-volume[87228]:   import eventlet  # noqa
Sep 11 22:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:32 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO dbcounter [None req-591ff445-2788-47a9-810a-3134545845da None None] Registered counter for database cinder
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_db.sqlalchemy.engines [None req-591ff445-2788-47a9-810a-3134545845da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG dbcounter [-] [87228] Writer thread running {{(pid=87228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO cinder.rpc [None req-591ff445-2788-47a9-810a-3134545845da None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO cinder.rpc [None req-591ff445-2788-47a9-810a-3134545845da None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_db.sqlalchemy.engines [None req-591ff445-2788-47a9-810a-3134545845da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-591ff445-2788-47a9-810a-3134545845da None None] Determined volume DB was empty at startup.
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG cinder.volume.manager [None req-591ff445-2788-47a9-810a-3134545845da None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87228) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-591ff445-2788-47a9-810a-3134545845da None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 11 22:59:33 devstack cinder-volume[87228]: WARNING stevedore.named [None req-591ff445-2788-47a9-810a-3134545845da None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 22:59:33 devstack cinder-volume[87228]: WARNING castellan.key_manager [None req-591ff445-2788-47a9-810a-3134545845da None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:59:33 devstack cinder-volume[87228]: WARNING cinder.keymgr.conf_key_mgr [None req-591ff445-2788-47a9-810a-3134545845da None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO cinder.volume.manager [None req-591ff445-2788-47a9-810a-3134545845da None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_db.sqlalchemy.engines [None req-591ff445-2788-47a9-810a-3134545845da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:33 devstack cinder-volume[87228]: INFO oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Starting 1 workers
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Started child 87443 {{(pid=87228) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Full set of CONF: {{(pid=87228) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] ******************************************************************************** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Configuration options gathered from: {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] ================================================================================ {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 22:59:33 devstack cinder-volume[87443]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] allow_availability_zone_fallback = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] allow_compression_on_image_upload = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] allowed_direct_url_schemes     = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] api_rate_limit                 = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] auth_strategy                  = keystone {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_availability_zone      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_host                   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_name                   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_stats_polling_interval = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backup_api_class               = cinder.backup.api.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backup_name_template           = backup-%s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backup_use_same_host           = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backup_use_temp_snapshot       = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] chap_password                  = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] chap_username                  =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:33 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_internal_tenant_project_id = e97de514a3c147b892b5418d67d2c3fb {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_internal_tenant_user_id = 8389fe0c358e4106ab9db4a4bca527d2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cluster                        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] compression_format             = gzip {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] compute_api_class              = cinder.compute.nova.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] config_dir                     = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] config_source                  = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] control_exchange               = openstack {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] debug                          = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] default_availability_zone      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] default_group_type             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] default_volume_type            = QuobyteHD {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] disk_geometry                  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_client_cert             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_client_cert_key         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_data_namespace          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_ssl_cert_path           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_ssl_cert_verify         = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] driver_use_ssl                 = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] enable_new_services            = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] enable_unsupported_driver      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] enabled_backends               = ['QuobyteHD'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] enforce_multipath_for_image_xfer = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] filter_function                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_api_insecure            = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_api_ssl_compression     = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_ca_certificates_file    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_catalog_info            = image:glance:publicURL {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_certfile                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_keyfile                 = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_num_retries             = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance_request_timeout         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] goodness_function              = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] graceful_shutdown_timeout      = 5 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] group_api_class                = cinder.group.api.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] host                           = devstack {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_compress_on_upload       = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_conversion_address_space_limit = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_conversion_cpu_limit     = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_conversion_disable       = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_introspection_address_space_limit = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_introspection_cpu_limit  = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_upload_use_cinder_backend = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_upload_use_internal_tenant = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_volume_cache_enabled     = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_volume_cache_max_count   = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] image_volume_cache_max_size_gb = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] init_host_max_objects_retrieval = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] instance_format                = [instance: %(uuid)s]  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iscsi_target_flags             =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iscsi_write_cache              = on {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iser_helper                    = tgtadm {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iser_ip_address                = 192.168.122.19 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iser_port                      = 3260 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_color                      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_config_append              = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_dir                        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_file                       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_options                    = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_rotate_interval            = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_rotate_interval_type       = days {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] log_rotation_type              = none {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] max_age                        = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] max_logfile_count              = 30 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] max_logfile_size_mb            = 200 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] max_over_subscription_ratio    = 20.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] message_reap_interval          = 86400 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] message_ttl                    = 2592000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] migration_create_volume_timeout_secs = 300 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] monkey_patch                   = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] monkey_patch_modules           = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] my_ip                          = 192.168.122.19 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] no_snapshot_gb_quota           = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] num_iser_scan_tries            = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] num_shell_tries                = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] num_volume_device_scan_tries   = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] nvmeof_conn_info_version       = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87443]: INFO cinder.volume.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.remotefs [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87443) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] nvmet_ns_id                    = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] nvmet_port_id                  = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_max_limit                = 1000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_ext_list          = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_listen_port       = 8776 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_use_ssl           = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] osapi_volume_workers           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] per_volume_size_limit          = -1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] periodic_fuzzy_delay           = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] periodic_interval              = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] public_endpoint                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] publish_errors                 = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_backup_gigabytes         = 1000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_backups                  = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_gigabytes                = 1000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_groups                   = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_snapshots                = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] quota_volumes                  = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] rate_limit_burst               = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] rate_limit_except_level        = CRITICAL {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] rate_limit_interval            = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] reinit_driver_count            = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] replication_device             = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] report_discard_supported       = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] report_interval                = 120 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] reservation_clean_interval     = 86400 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] reservation_expire             = 86400 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] reserved_image_namespaces      = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] reserved_percentage            = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] rpc_response_timeout           = 120 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] run_external_periodic_tasks    = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] scst_target_driver             = iscsi {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] scst_target_iqn_name           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_down_time              = 720 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] shell_completion               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] snapshot_name_template         = snapshot-%s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] split_loggers                  = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] state_path                     = /opt/stack/data/cinder {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] storage_availability_zone      = nova {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] storage_protocol               = iSCSI {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] syslog_log_facility            = LOG_USER {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_helper                  = lioadm {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_ip_address              = 192.168.122.19 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_port                    = 3260 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_protocol                = iscsi {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] target_secondary_ip_addresses  = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] trace_flags                    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] transport_url                  = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] until_refresh                  = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_chap_auth                  = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_default_quota_class        = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_journal                    = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_json                       = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_multipath_for_image_xfer   = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_stderr                     = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] use_syslog                     = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] verify_glance_signatures       = enabled {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_api_class               = cinder.volume.api.API {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_backend_name            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_clear                   = zero {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_clear_ionice            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_clear_size              = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_copy_bps_limit          = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_dd_blocksize            = 1M {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_name_template           = volume-%s {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_service_inithost_offload = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volume_usage_audit_period      = month {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] zoning_mode                    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_concurrency.disable_process_locking = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.auth_section = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.auth_type   = password {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.auth_version = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.cache       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.certfile    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.delay_auth_decision = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.http_connect_timeout = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.include_service_catalog = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.insecure    = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.interface   = public {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.keyfile     = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_password = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcache_username = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.region_name = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.service_token_roles_required = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.service_type = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.token_cache_time = 300 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.backend                  = dogpile.cache.null {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.backend_argument         = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.backend_expiration_time  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.config_prefix            = cache.oslo {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.debug_cache_backend      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.enable_retry_client      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.enable_socket_keepalive  = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.enabled                  = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.expiration_time          = 600 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.hashclient_retry_attempts = 2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87443) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 11 22:59:34 devstack cinder-volume[87443]: WARNING cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 11 22:59:34 devstack cinder-volume[87443]: WARNING cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_dead_retry      = 300 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Running cmd (subprocess): mount.quobyte {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_pool_maxsize    = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_sasl_enabled    = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.password                 = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.proxies                  = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.redis_db                 = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.redis_sentinel_service_name = mymaster {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.redis_server             = localhost:6379 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.retry_attempts           = 2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.retry_delay              = 0.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.socket_keepalive_count   = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.socket_keepalive_idle    = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.socket_keepalive_interval = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.socket_timeout           = 1.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.tls_allowed_ciphers      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.tls_cafile               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.tls_certfile             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.tls_enabled              = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.tls_keyfile              = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cache.username                 = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] coordination.backend_url       = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.asyncio_connection    = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.asyncio_slave_connection = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.backend               = sqlalchemy {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.connection            = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.connection_debug      = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.connection_parameters =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.connection_recycle_time = 3600 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.connection_trace      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.db_inc_retry_interval = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.db_max_retries        = 20 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.db_max_retry_interval = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.db_retry_interval     = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.max_overflow          = 50 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.max_pool_size         = 5 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.max_retries           = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.mysql_wsrep_sync_wait = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.pool_timeout          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.retry_interval        = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.slave_connection      = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.sqlite_synchronous    = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.synchronous_reader    = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] database.use_db_reconnect      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_tracing.insecure = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.connection_string     = messaging:// {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.enabled               = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.es_doc_type           = notification {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.es_scroll_size        = 10000 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.es_scroll_time        = 2m {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.filter_error_trace    = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.hmac_keys             = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.sentinel_service_name = mymaster {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.socket_timeout        = 0.1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.trace_requests        = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler.trace_sqlalchemy      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler_jaeger.process_tags   = {} {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler_jaeger.service_name_prefix = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] profiler_otlp.service_name_prefix = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.enforce_new_defaults = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.policy_default_rule = default {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.policy_file        = policy.yaml {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.group          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.helper_command = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] privsep_osbrick.user           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.group         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.helper_command = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] cinder_sys_admin.user          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.auth_section      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.auth_type         = password {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.cafile            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.certfile          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.collect_timing    = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.insecure          = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.keyfile           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.send_service_user_token = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.split_loggers     = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.timeout           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.tls_ciphers       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] service_user.tls_min_version   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.auth_section            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.auth_type               = password {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.certfile                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.collect_timing          = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.insecure                = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.keyfile                 = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.region_name             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.split_loggers           = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.timeout                 = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.tls_ciphers             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] glance.tls_min_version         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.backend_availability_zone = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.chap_password = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.chap_username =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.disk_geometry = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_client_cert = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_client_cert_key = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_data_namespace = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.driver_use_ssl = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.enable_unsupported_driver = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.extra_capabilities = {} {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.filter_function = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.goodness_function = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iscsi_target_flags =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iscsi_write_cache = on {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iser_helper   = tgtadm {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iser_port     = 3260 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_host      =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_login     = admin {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_mount_options = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_password  = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_private_key =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_share_path =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.num_shell_tries = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.nvmet_port_id = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_client_cfg = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.quobyte_volume_url = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.replication_device = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.report_discard_supported = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.reserved_percentage = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.scst_target_driver = iscsi {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.scst_target_iqn_name = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.storage_protocol = iSCSI {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_helper = tgtadm {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_port   = 3260 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_protocol = iscsi {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.trace_flags   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.unique_fqdn_network = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.use_chap_auth = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_backend_name = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_clear  = zero {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_clear_ionice = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_clear_size = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_reports.file_event_handler = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_reports.log_dir           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.backend_availability_zone = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.backend_host         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.chap_password        = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.chap_username        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.chiscsi_conf         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.disk_geometry        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_client_cert   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_client_cert_key = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_data_namespace = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.driver_use_ssl       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.extra_capabilities   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.filter_function      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.goodness_function    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iser_helper          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iser_ip_address      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iser_port            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.iser_target_prefix   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_host             = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_login            = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_mount_options    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_password         = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_private_key      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_share_path       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_ssh_port         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.num_shell_tries      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.nvmet_port_id        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.replication_device   = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.report_discard_supported = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.reserved_percentage  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.scst_target_driver   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.storage_protocol     = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_helper        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_ip_address    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_port          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_prefix        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_protocol      = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.trace_flags          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.use_chap_auth        = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_clear         = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_clear_size    = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] QuobyteHD.volumes_dir          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] CMD "mount.quobyte" returned: 1 in 0.152s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=87443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl      = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: INFO cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 ...
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_notifications.driver = [] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_notifications.retry = -1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] oslo_messaging_notifications.transport_url = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc -c /etc/quobyte/client-cinder.cfg {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] key_manager.fixed_key          = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.barbican_api_version  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.barbican_endpoint     = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.barbican_endpoint_type = public {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.barbican_region_name  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.cafile                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.certfile              = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.collect_timing        = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.insecure              = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.keyfile               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.number_of_retries     = 60 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.retry_delay           = 1 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.send_service_user_token = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.split_loggers         = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.timeout               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.tls_ciphers           = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.tls_min_version       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.verify_ssl            = True {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican.verify_ssl_path       = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.auth_section = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.auth_type = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.cafile   = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.certfile = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.collect_timing = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.insecure = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.keyfile  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.split_loggers = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.timeout  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.tls_ciphers = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] barbican_service_user.tls_min_version = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.approle_role_id          = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.approle_secret_id        = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.auth_method              = approle {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.auth_path                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.kv_mountpoint            = secret {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.kv_path                  = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.kv_version               = 2 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.namespace                = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.root_token_id            = **** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.ssl_ca_crt_file          = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.timeout                  = 60.0 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.token_file               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.token_role               = None {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.use_ssl                  = False {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:34 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] ******************************************************************************** {{(pid=87228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 22:59:34 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc -c /etc/quobyte/client-cinder.cfg
Sep 11 22:59:34 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:34 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.394s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:34 devstack cinder-volume[87443]: INFO cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 succeeded
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=87443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.417s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:34 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:34 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:34 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.242s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:34 devstack cinder-volume[87443]: INFO cinder.volume.driver [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 22:59:34 devstack cinder-volume[87443]: DEBUG cinder.volume.driver [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87443) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_db.sqlalchemy.engines [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87443) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG dbcounter [-] [87443] Writer thread running {{(pid=87443) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.db.api [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Building query based on filter {{(pid=87443) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.image.image_utils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87443) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.keymgr.migration [None req-872d68ad-0a50-4fe9-9078-160e7ea27703 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=87443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=87443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:35 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:35 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:35 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.241s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Notifying Schedulers of capabilities ... {{(pid=87443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.volume.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Driver initialization completed successfully.
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Initiating service 3 cleanup
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Service 3 cleanup completed.
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.service [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Creating RPC server for service cinder-volume {{(pid=87443) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.service [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87443) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.volume.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=87443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=87443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:35 devstack sudo[87525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:35 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:35 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:35 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.249s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:35 devstack cinder-volume[87443]: INFO cinder.volume.manager [None req-53ae91c2-21d1-4d04-ae2b-342b2e973ff8 None None] Driver post RPC initialization completed successfully.
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=87443) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG cinder.volume.drivers.quobyte [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=87443) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87443) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:40 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:40 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:40 devstack cinder-volume[87228]: INFO oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Caught SIGTERM, stopping children
Sep 11 22:59:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Acquiring lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Acquired lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:40 devstack cinder-volume[87228]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Releasing lock "singleton_lock" {{(pid=87228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:40 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Stop services. {{(pid=87228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 11 22:59:40 devstack cinder-volume[87228]: DEBUG oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Killing children. {{(pid=87228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 11 22:59:40 devstack cinder-volume[87228]: INFO oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Waiting on 1 children to exit
Sep 11 22:59:40 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG oslo_concurrency.processutils [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.310s {{(pid=87443) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:40 devstack cinder-volume[87443]: DEBUG cinder.manager [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Notifying Schedulers of capabilities ... {{(pid=87443) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server [None req-4c066365-6e01-48dd-af64-1c3b8de91551 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     method()
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return _publish(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     listener(*args)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server 
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server 
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self.transport._send(
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.19:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 11 22:59:40 devstack cinder-volume[87443]: ERROR oslo_messaging.rpc.server 
Sep 11 22:59:43 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Acquiring lock "singleton_lock" {{(pid=87443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:43 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Acquired lock "singleton_lock" {{(pid=87443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:43 devstack cinder-volume[87443]: DEBUG oslo_concurrency.lockutils [None req-591ff445-2788-47a9-810a-3134545845da None None] Releasing lock "singleton_lock" {{(pid=87443) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:43 devstack cinder-volume[87443]: WARNING amqp [None req-591ff445-2788-47a9-810a-3134545845da None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 22:59:43 devstack cinder-volume[87443]: WARNING amqp [None req-591ff445-2788-47a9-810a-3134545845da None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 11 22:59:43 devstack cinder-volume[87228]: INFO oslo_service.backend._eventlet.service [None req-591ff445-2788-47a9-810a-3134545845da None None] Child 87443 exited with status 0
Sep 11 22:59:44 devstack cinder-volume[87728]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 11 22:59:44 devstack cinder-volume[87728]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 22:59:44 devstack cinder-volume[87728]: we strongly recommend against using it for new projects.
Sep 11 22:59:44 devstack cinder-volume[87728]: If you are already using Eventlet, we recommend migrating to a different
Sep 11 22:59:44 devstack cinder-volume[87728]: framework.  For more detail see
Sep 11 22:59:44 devstack cinder-volume[87728]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 22:59:44 devstack cinder-volume[87728]:   import eventlet  # noqa
Sep 11 22:59:46 devstack cinder-volume[87728]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 11 22:59:46 devstack cinder-volume[87728]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 11 22:59:46 devstack cinder-volume[87728]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87728) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 11 22:59:47 devstack cinder-volume[87728]: INFO dbcounter [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Registered counter for database cinder
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_db.sqlalchemy.engines [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG dbcounter [-] [87728] Writer thread running {{(pid=87728) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:59:48 devstack cinder-volume[87728]: INFO cinder.rpc [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 11 22:59:48 devstack cinder-volume[87728]: INFO cinder.rpc [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_db.sqlalchemy.engines [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:48 devstack cinder-volume[87728]: INFO cinder.volume.manager [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Determined volume DB was empty at startup.
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG cinder.volume.manager [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87728) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 11 22:59:48 devstack cinder-volume[87728]: WARNING stevedore.named [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 11 22:59:48 devstack cinder-volume[87728]: WARNING castellan.key_manager [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:59:48 devstack cinder-volume[87728]: WARNING cinder.keymgr.conf_key_mgr [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 11 22:59:48 devstack cinder-volume[87728]: INFO cinder.volume.manager [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_db.sqlalchemy.engines [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87728) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:48 devstack cinder-volume[87728]: INFO oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Starting 1 workers
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Started child 88022 {{(pid=87728) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 11 22:59:48 devstack cinder-volume[88022]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Full set of CONF: {{(pid=87728) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] ******************************************************************************** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] Configuration options gathered from: {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] ================================================================================ {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] allow_availability_zone_fallback = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] allow_compression_on_image_upload = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] allowed_direct_url_schemes     = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] api_rate_limit                 = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] auth_strategy                  = keystone {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_availability_zone      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_host                   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_name                   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_stats_polling_interval = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backup_api_class               = cinder.backup.api.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backup_name_template           = backup-%s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backup_use_same_host           = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backup_use_temp_snapshot       = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] chap_password                  = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] chap_username                  =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_internal_tenant_project_id = e97de514a3c147b892b5418d67d2c3fb {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_internal_tenant_user_id = 8389fe0c358e4106ab9db4a4bca527d2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cluster                        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] compression_format             = gzip {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] config_dir                     = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] config_source                  = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] control_exchange               = openstack {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] debug                          = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] default_availability_zone      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] default_group_type             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] default_volume_type            = QuobyteHD {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] disk_geometry                  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_client_cert             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_client_cert_key         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_data_namespace          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_ssl_cert_path           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_ssl_cert_verify         = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] driver_use_ssl                 = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] enable_new_services            = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] enable_unsupported_driver      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] enforce_multipath_for_image_xfer = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] filter_function                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_api_insecure            = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88022) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_api_servers             = ['http://192.168.122.19/image'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_api_ssl_compression     = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_ca_certificates_file    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_certfile                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_keyfile                 = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_num_retries             = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance_request_timeout         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] goodness_function              = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] graceful_shutdown_timeout      = 5 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] group_api_class                = cinder.group.api.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] host                           = devstack {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_compress_on_upload       = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_conversion_address_space_limit = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_conversion_cpu_limit     = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_conversion_disable       = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_introspection_address_space_limit = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_introspection_cpu_limit  = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_upload_use_cinder_backend = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_upload_use_internal_tenant = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_volume_cache_enabled     = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_volume_cache_max_count   = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] image_volume_cache_max_size_gb = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] init_host_max_objects_retrieval = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iscsi_target_flags             =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iscsi_write_cache              = on {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iser_helper                    = tgtadm {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iser_ip_address                = 192.168.122.19 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iser_port                      = 3260 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_color                      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_config_append              = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_dir                        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_file                       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_options                    = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_rotate_interval            = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_rotate_interval_type       = days {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] log_rotation_type              = none {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] max_age                        = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] max_logfile_count              = 30 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] max_logfile_size_mb            = 200 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] max_over_subscription_ratio    = 20.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] message_reap_interval          = 86400 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] message_ttl                    = 2592000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] migration_create_volume_timeout_secs = 300 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] monkey_patch                   = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] monkey_patch_modules           = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] my_ip                          = 192.168.122.19 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] no_snapshot_gb_quota           = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] num_iser_scan_tries            = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] num_shell_tries                = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] num_volume_device_scan_tries   = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] nvmeof_conn_info_version       = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] nvmet_ns_id                    = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] nvmet_port_id                  = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_max_limit                = 1000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_ext_list          = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_listen_port       = 8776 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_use_ssl           = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] osapi_volume_workers           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] per_volume_size_limit          = -1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] periodic_fuzzy_delay           = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] periodic_interval              = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] public_endpoint                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] publish_errors                 = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_backup_gigabytes         = 1000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_backups                  = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_gigabytes                = 1000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_groups                   = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_snapshots                = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] quota_volumes                  = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] rate_limit_burst               = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] rate_limit_except_level        = CRITICAL {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] rate_limit_interval            = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88022) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 11 22:59:48 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 11 22:59:48 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Running cmd (subprocess): mount.quobyte {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] reinit_driver_count            = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] replication_device             = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] report_discard_supported       = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] report_interval                = 120 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] reservation_clean_interval     = 86400 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] reservation_expire             = 86400 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] reserved_image_namespaces      = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] reserved_percentage            = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] rpc_response_timeout           = 120 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] run_external_periodic_tasks    = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] scst_target_driver             = iscsi {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] scst_target_iqn_name           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_down_time              = 720 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] shell_completion               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] snapshot_name_template         = snapshot-%s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] split_loggers                  = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] state_path                     = /opt/stack/data/cinder {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] storage_availability_zone      = nova {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] storage_protocol               = iSCSI {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] syslog_log_facility            = LOG_USER {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_helper                  = lioadm {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_ip_address              = 192.168.122.19 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_port                    = 3260 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_protocol                = iscsi {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] target_secondary_ip_addresses  = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] trace_flags                    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] transport_url                  = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] until_refresh                  = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_chap_auth                  = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_default_quota_class        = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_journal                    = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_json                       = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_multipath_for_image_xfer   = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_stderr                     = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] use_syslog                     = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] verify_glance_signatures       = enabled {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_api_class               = cinder.volume.api.API {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_backend_name            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_clear                   = zero {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_clear_ionice            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_clear_size              = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_copy_bps_limit          = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_dd_blocksize            = 1M {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_name_template           = volume-%s {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_service_inithost_offload = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volume_usage_audit_period      = month {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] zoning_mode                    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_concurrency.disable_process_locking = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.auth_section = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.auth_type   = password {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.auth_version = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.cache       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.certfile    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.include_service_catalog = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.insecure    = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.interface   = public {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.keyfile     = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_password = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcache_username = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.region_name = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.service_type = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.19/identity {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.backend                  = dogpile.cache.null {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.backend_argument         = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.backend_expiration_time  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.config_prefix            = cache.oslo {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.debug_cache_backend      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.enable_retry_client      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.enable_socket_keepalive  = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.enabled                  = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.expiration_time          = 600 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.hashclient_retry_attempts = 2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_dead_retry      = 300 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_sasl_enabled    = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.password                 = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.proxies                  = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.redis_db                 = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.redis_server             = localhost:6379 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.retry_attempts           = 2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.retry_delay              = 0.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.socket_keepalive_count   = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.socket_keepalive_idle    = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.socket_keepalive_interval = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.socket_timeout           = 1.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.tls_allowed_ciphers      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.tls_cafile               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.tls_certfile             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.tls_enabled              = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.tls_keyfile              = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cache.username                 = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] coordination.backend_url       = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.asyncio_connection    = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.asyncio_slave_connection = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.backend               = sqlalchemy {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.connection            = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack quobyte-client[88024]: Reading configuration file: /etc/quobyte/client.cfg
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.connection_debug      = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.connection_parameters =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.connection_recycle_time = 3600 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.connection_trace      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.db_inc_retry_interval = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.db_max_retries        = 20 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.db_max_retry_interval = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack quobyte-client[88024]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.db_retry_interval     = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.max_overflow          = 50 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.max_pool_size         = 5 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.max_retries           = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.mysql_wsrep_sync_wait = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.pool_timeout          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.retry_interval        = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.slave_connection      = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.sqlite_synchronous    = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.synchronous_reader    = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] database.use_db_reconnect      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_tracing.insecure = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.connection_string     = messaging:// {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.enabled               = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.es_doc_type           = notification {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.es_scroll_size        = 10000 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.es_scroll_time        = 2m {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.filter_error_trace    = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.hmac_keys             = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] CMD "mount.quobyte" returned: 1 in 0.076s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.sentinel_service_name = mymaster {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.socket_timeout        = 0.1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.trace_requests        = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler.trace_sqlalchemy      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler_jaeger.process_tags   = {} {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler_jaeger.service_name_prefix = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] profiler_otlp.service_name_prefix = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.enforce_new_defaults = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.policy_default_rule = default {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.group          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.helper_command = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] privsep_osbrick.user           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.group         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.helper_command = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] cinder_sys_admin.user          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.auth_section      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.auth_type         = password {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.cafile            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.certfile          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.collect_timing    = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.insecure          = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.keyfile           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.send_service_user_token = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.split_loggers     = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.timeout           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.tls_ciphers       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] service_user.tls_min_version   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.auth_section            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.auth_type               = password {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.certfile                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.collect_timing          = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.insecure                = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.keyfile                 = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.region_name             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.split_loggers           = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.timeout                 = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.tls_ciphers             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] glance.tls_min_version         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.backend_availability_zone = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.chap_password = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.chap_username =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.disk_geometry = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_client_cert = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_client_cert_key = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_data_namespace = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.driver_use_ssl = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.extra_capabilities = {} {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.filter_function = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.goodness_function = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iscsi_target_flags =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iscsi_write_cache = on {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iser_ip_address = 192.168.122.19 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iser_port     = 3260 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_host      =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_login     = admin {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_mount_options = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_password  = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_private_key =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_share_path =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.num_shell_tries = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.quobyte_volume_url = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.replication_device = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.report_discard_supported = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.reserved_percentage = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_helper = tgtadm {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_ip_address = 192.168.122.19 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_port   = 3260 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_protocol = iscsi {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.trace_flags   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.unique_fqdn_network = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.use_chap_auth = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_backend_name = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_clear  = zero {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_clear_ionice = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_clear_size = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_reports.file_event_handler = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_reports.log_dir           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.backend_availability_zone = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.backend_host         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.chap_password        = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.chap_username        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.disk_geometry        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_client_cert   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_data_namespace = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.extra_capabilities   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.filter_function      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.goodness_function    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack sudo[88025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iser_helper          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iser_ip_address      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iser_port            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_host             = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_login            = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_mount_options    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_password         = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_private_key      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_share_path       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.num_shell_tries      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.replication_device   = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.report_discard_supported = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.reserved_percentage  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.scst_target_driver   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.storage_protocol     = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_helper        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_ip_address    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_port          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_prefix        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_protocol      = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.trace_flags          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.use_chap_auth        = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_clear         = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_clear_size    = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] QuobyteHD.volumes_dir          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:48 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_notifications.driver = [] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_notifications.retry = -1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] key_manager.fixed_key          = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.barbican_api_version  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.barbican_endpoint     = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.barbican_endpoint_type = public {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.barbican_region_name  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.cafile                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.certfile              = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.collect_timing        = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.insecure              = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.keyfile               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.number_of_retries     = 60 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.retry_delay           = 1 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.send_service_user_token = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.split_loggers         = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.timeout               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.tls_ciphers           = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.tls_min_version       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.verify_ssl            = True {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican.verify_ssl_path       = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.auth_section = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.auth_type = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.cafile   = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.certfile = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.collect_timing = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.insecure = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.keyfile  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.split_loggers = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.timeout  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.tls_ciphers = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] barbican_service_user.tls_min_version = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.approle_role_id          = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.approle_secret_id        = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.auth_method              = approle {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.auth_path                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.kv_mountpoint            = secret {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.kv_path                  = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.kv_version               = 2 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.namespace                = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.root_token_id            = **** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.ssl_ca_crt_file          = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.timeout                  = 60.0 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.token_file               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.token_role               = None {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.use_ssl                  = False {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 11 22:59:49 devstack cinder-volume[87728]: DEBUG oslo_service.backend._eventlet.service [None req-19ce9918-2e04-476c-a7c6-3f7287968137 None None] ******************************************************************************** {{(pid=87728) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 11 22:59:49 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.volume.driver [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Driver hasn't implemented _init_vendor_properties()
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.volume.driver [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88022) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_db.sqlalchemy.engines [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88022) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writer thread running {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.db.api [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Building query based on filter {{(pid=88022) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88022) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.keymgr.migration [None req-0597d4d4-a72d-4988-a2b9-a57813d81e33 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 11 22:59:49 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:49 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:49 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Driver initialization completed successfully.
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Initiating service 3 cleanup
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Service 3 cleanup completed.
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.service [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Creating RPC server for service cinder-volume {{(pid=88022) start /opt/stack/cinder/cinder/service.py:231}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.service [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88022) start /opt/stack/cinder/cinder/service.py:237}}
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 22:59:49 devstack sudo[88047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 22:59:49 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 22:59:49 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root
Sep 11 22:59:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.234s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 22:59:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-df9115c5-f010-4988-86c6-205a7b095022 None None] Driver post RPC initialization completed successfully.
Sep 11 22:59:58 devstack cinder-volume[87728]: DEBUG dbcounter [-] [87728] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87728) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:59:59 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 22:59:59 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=3 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:00:45 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:00:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 6 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:00:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Flow 'volume_create_manager' (cbe03641-aa6e-44e1-a448-dd5729de8eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4241174c-d6c5-4442-a393-1f1319f9d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4241174c-d6c5-4442-a393-1f1319f9d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1736822025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238cd652-0d46-4628-8f79-5ffc5c0f8228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b64f635730475698fde2c313fd63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:03Z,use_quota=True,user_id='40d9369cee4544bfab82da46a9873bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e92a35f-03e2-4b9c-a803-4f4355a97894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e92a35f-03e2-4b9c-a803-4f4355a97894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869209d-5a07-4ee8-8a0b-05ffcd43b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8869209d-5a07-4ee8-8a0b-05ffcd43b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238cd652-0d46-4628-8f79-5ffc5c0f8228', 'volume_name': 'volume-238cd652-0d46-4628-8f79-5ffc5c0f8228', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc9e9ea-7a8e-4b7b-b15d-6bf4d6f1d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc9e9ea-7a8e-4b7b-b15d-6bf4d6f1d42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc54172a-08cd-437a-a035-48d7699c910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:04 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Volume 238cd652-0d46-4628-8f79-5ffc5c0f8228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238cd652-0d46-4628-8f79-5ffc5c0f8228', 'volume_size': 1}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1736822025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=238cd652-0d46-4628-8f79-5ffc5c0f8228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b64f635730475698fde2c313fd63c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:03Z,use_quota=True,user_id='40d9369cee4544bfab82da46a9873bb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Creating volume 238cd652-0d46-4628-8f79-5ffc5c0f8228 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:01:04 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:01:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:04 devstack sudo[88824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 1073741824
Sep 11 23:01:04 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:05 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 1073741824" returned: 0 in 1.505s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:05 devstack sudo[89147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228
Sep 11 23:01:05 devstack sudo[89147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:06 devstack sudo[89147]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228" returned: 0 in 0.444s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] <== create_volume: return (2104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc54172a-08cd-437a-a035-48d7699c910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238cd652-0d46-4628-8f79-5ffc5c0f8228', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70f33f-bbc1-4491-afec-0268b30fcd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Volume volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 (238cd652-0d46-4628-8f79-5ffc5c0f8228): created successfully
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70f33f-bbc1-4491-afec-0268b30fcd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Flow 'volume_create_manager' (cbe03641-aa6e-44e1-a448-dd5729de8eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e5298e4b-af01-4093-8462-973d270f56a3 tempest-DeleteServersTestJSON-1421346079 None] Created volume successfully.
Sep 11 23:01:14 devstack cinder-volume[88022]: WARNING py.warnings [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Sep 11 23:01:14 devstack cinder-volume[88022]:   .first()
Sep 11 23:01:14 devstack cinder-volume[88022]: 
Sep 11 23:01:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.117s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-238cd652-0d46-4628-8f79-5ffc5c0f8228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcd7abc8-58e8-4adc-9cb3-1337fc14e512', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:01:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-8d647ddc-ef00-4898-a5a4-110fafa2a868 req-c6287554-e8ec-4ec3-ada7-40626d55d5c7 tempest-DeleteServersTestJSON-1421346079 None] attachment_update completed successfully.
Sep 11 23:01:25 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:01:25 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=7,cinder:SELECT=7,cinder:INSERT=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:01:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-032da7f6-cc54-4387-b0d7-5530a13432bb req-e804a1d0-4a63-47cf-9176-d3a64dd4d3b1 tempest-DeleteServersTestJSON-1421346079 None] Terminate volume connection completed successfully.
Sep 11 23:01:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-032da7f6-cc54-4387-b0d7-5530a13432bb req-e804a1d0-4a63-47cf-9176-d3a64dd4d3b1 tempest-DeleteServersTestJSON-1421346079 None] Deleting attachment bcd7abc8-58e8-4adc-9cb3-1337fc14e512. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Flow 'volume_create_manager' (b1beed7c-977b-480f-a241-d869ec8e8bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9738c9dc-c063-4982-8297-07b7a3c6fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9738c9dc-c063-4982-8297-07b7a3c6fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1541645206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe0929e-15d6-4095-b62b-2925db84588b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df41d73b85b4973a8c5713b6ff14123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:26Z,use_quota=True,user_id='bc7ed68eaaad4891a8d9749f794e38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0935acc-fcc8-42d7-adb1-bb51ea5ed7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0935acc-fcc8-42d7-adb1-bb51ea5ed7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa005c0-4b65-4ee2-a273-ece1a3b0d2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa005c0-4b65-4ee2-a273-ece1a3b0d2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe0929e-15d6-4095-b62b-2925db84588b', 'volume_name': 'volume-8fe0929e-15d6-4095-b62b-2925db84588b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a8ef5b-dd7a-40aa-ba70-22b1236ea46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a8ef5b-dd7a-40aa-ba70-22b1236ea46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836ea967-3936-4107-b316-d02c825ea05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Volume 8fe0929e-15d6-4095-b62b-2925db84588b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe0929e-15d6-4095-b62b-2925db84588b', 'volume_size': 1}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1541645206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe0929e-15d6-4095-b62b-2925db84588b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2df41d73b85b4973a8c5713b6ff14123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:26Z,use_quota=True,user_id='bc7ed68eaaad4891a8d9749f794e38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Creating volume 8fe0929e-15d6-4095-b62b-2925db84588b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:01:26 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:01:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:26 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b 1073741824
Sep 11 23:01:26 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:27 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b 1073741824" returned: 0 in 1.094s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:27 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b
Sep 11 23:01:27 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "cinder-238cd652-0d46-4628-8f79-5ffc5c0f8228-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "cinder-238cd652-0d46-4628-8f79-5ffc5c0f8228-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "cinder-quobyte-238cd652-0d46-4628-8f79-5ffc5c0f8228" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "cinder-quobyte-238cd652-0d46-4628-8f79-5ffc5c0f8228" acquired by "delete_volume" :: waited 0.055s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:28 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9pzh0i3i/privsep.sock']
Sep 11 23:01:28 devstack sudo[89820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9pzh0i3i/privsep.sock
Sep 11 23:01:28 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:28 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b" returned: 0 in 0.528s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836ea967-3936-4107-b316-d02c825ea05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe0929e-15d6-4095-b62b-2925db84588b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39a421c-10a0-48ef-8761-9bd7e38ddfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Volume volume-8fe0929e-15d6-4095-b62b-2925db84588b (8fe0929e-15d6-4095-b62b-2925db84588b): created successfully
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39a421c-10a0-48ef-8761-9bd7e38ddfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Flow 'volume_create_manager' (b1beed7c-977b-480f-a241-d869ec8e8bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6206e5bc-0535-4dd2-a844-fee4508b9e11 tempest-ServerRescueNegativeTestJSON-361153381 None] Created volume successfully.
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Flow 'volume_create_manager' (f391438d-e8ff-4a6a-b5bb-80bd512e1dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06bfa8d-3b7b-405f-991a-e34e2e16fa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f06bfa8d-3b7b-405f-991a-e34e2e16fa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-780916747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4836090e-975c-40d1-92c0-3ca3dabe0472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d28d85f1b3446839eebb2dcc9d1ce94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:29Z,use_quota=True,user_id='386fa22b2fd948cd803aae36fd0eae65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b90bda6-bdd0-49a4-a14f-53358e54bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b90bda6-bdd0-49a4-a14f-53358e54bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78986c38-8693-435e-9835-907ecae1a948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78986c38-8693-435e-9835-907ecae1a948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4836090e-975c-40d1-92c0-3ca3dabe0472', 'volume_name': 'volume-4836090e-975c-40d1-92c0-3ca3dabe0472', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3030e0b8-412d-4152-ba12-9851f76a5a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3030e0b8-412d-4152-ba12-9851f76a5a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0781b2-08c9-49bd-b14a-038d7a9ac203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Volume 4836090e-975c-40d1-92c0-3ca3dabe0472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4836090e-975c-40d1-92c0-3ca3dabe0472', 'volume_size': 1}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-780916747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4836090e-975c-40d1-92c0-3ca3dabe0472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d28d85f1b3446839eebb2dcc9d1ce94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:01:29Z,use_quota=True,user_id='386fa22b2fd948cd803aae36fd0eae65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Creating volume 4836090e-975c-40d1-92c0-3ca3dabe0472 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:01:29 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:01:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:29 devstack sudo[89824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 1073741824
Sep 11 23:01:29 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:30 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 1073741824" returned: 0 in 1.007s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 11 23:01:30 devstack cinder-volume[88022]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 11 23:01:30 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472
Sep 11 23:01:30 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:30 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:30 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Spawned new privsep daemon via rootwrap
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Accepted privsep connection to /tmp/tmp9pzh0i3i/privsep.sock {{(pid=88022) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 11 23:01:30 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 11 23:01:30 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 11 23:01:30 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 11 23:01:30 devstack cinder-volume[88022]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89832
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ee05a6-d5d6-4171-afec-78f7306edb77]: (2,) {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:01:30 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472" returned: 0 in 0.485s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac0781b2-08c9-49bd-b14a-038d7a9ac203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4836090e-975c-40d1-92c0-3ca3dabe0472', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44779d43-13c3-42bb-9f0c-44efe7b2c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90c9b69-df7f-4bfb-bd19-274f6c3bed76]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:31 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Volume volume-4836090e-975c-40d1-92c0-3ca3dabe0472 (4836090e-975c-40d1-92c0-3ca3dabe0472): created successfully
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44779d43-13c3-42bb-9f0c-44efe7b2c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Flow 'volume_create_manager' (f391438d-e8ff-4a6a-b5bb-80bd512e1dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:01:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-06c9f0ff-1263-4b18-94a2-069832f6e872 tempest-VolumesAdminNegativeTest-1655171148 None] Created volume successfully.
Sep 11 23:01:31 devstack sudo[89836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228
Sep 11 23:01:31 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:31 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228" returned: 0 in 0.942s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:31 devstack sudo[89843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228
Sep 11 23:01:31 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:32 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-238cd652-0d46-4628-8f79-5ffc5c0f8228" returned: 0 in 0.459s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "cinder-quobyte-238cd652-0d46-4628-8f79-5ffc5c0f8228" released by "delete_volume" :: held 4.470s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:01:32 devstack cinder-volume[88022]: WARNING cinder.quota [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:01:32 devstack cinder-volume[88022]: WARNING cinder.quota [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Created reservations ['292feb20-d942-4d46-a06a-77d002103b3a', '6541d9bd-c05e-4a83-ab1a-83ac63a2dea6', 'dfa431a5-e30a-489a-a43f-26e39f06c637', '03e4533b-e17b-4fea-b4a0-ab2f8ccc27be'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:32 devstack sudo[89857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:01:32 devstack sudo[89857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:33 devstack sudo[89857]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:33 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:01:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Deleted volume successfully.
Sep 11 23:01:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58809478-1161-407a-addc-85d81e9166e7 tempest-DeleteServersTestJSON-1421346079 None] Lock "cinder-238cd652-0d46-4628-8f79-5ffc5c0f8228-delete_volume" released by "delete_volume" :: held 5.482s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Acquiring lock "cinder-4836090e-975c-40d1-92c0-3ca3dabe0472-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "cinder-4836090e-975c-40d1-92c0-3ca3dabe0472-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Acquiring lock "cinder-quobyte-4836090e-975c-40d1-92c0-3ca3dabe0472" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "cinder-quobyte-4836090e-975c-40d1-92c0-3ca3dabe0472" acquired by "delete_volume" :: waited 0.056s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bcff3e-5f35-4168-8af8-c047b25aeeb9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:01:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:34 devstack sudo[89886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472
Sep 11 23:01:34 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:35 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472" returned: 0 in 0.901s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:35 devstack sudo[89910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472
Sep 11 23:01:35 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:36 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4836090e-975c-40d1-92c0-3ca3dabe0472" returned: 0 in 0.560s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "cinder-quobyte-4836090e-975c-40d1-92c0-3ca3dabe0472" released by "delete_volume" :: held 1.644s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Created reservations ['d536756d-7158-4818-b7c1-c50fed4433d3', 'c8ce0286-6c90-4db6-8569-fffe97eaf593', 'f80aab49-8128-4ea4-bb98-309f3f060689', 'de047c55-d553-4f23-acdf-ccd7fdcf3f46'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:36 devstack sudo[89924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:01:36 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:37 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.545s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:37 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:01:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Deleted volume successfully.
Sep 11 23:01:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bace3d65-a745-4c47-a0d2-0aa5a35c7e04 tempest-VolumesAdminNegativeTest-1655171148 None] Lock "cinder-4836090e-975c-40d1-92c0-3ca3dabe0472-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:46 devstack sudo[89986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:01:46 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:46 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.529s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 8 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:01:46 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:01:47 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=25,cinder:SELECT=15,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Acquiring lock "cinder-8fe0929e-15d6-4095-b62b-2925db84588b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "cinder-8fe0929e-15d6-4095-b62b-2925db84588b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Acquiring lock "cinder-quobyte-8fe0929e-15d6-4095-b62b-2925db84588b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "cinder-quobyte-8fe0929e-15d6-4095-b62b-2925db84588b" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[391cc494-47b0-41c0-977e-7237418ee2f0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:01:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:55 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b
Sep 11 23:01:55 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:56 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b" returned: 0 in 0.576s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:56 devstack sudo[90033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b
Sep 11 23:01:56 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:56 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8fe0929e-15d6-4095-b62b-2925db84588b" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "cinder-quobyte-8fe0929e-15d6-4095-b62b-2925db84588b" released by "delete_volume" :: held 0.948s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Created reservations ['5a1579f3-e756-43d7-9357-08e06a99c545', '3b75deb5-3bf8-4e03-a71b-438b92c4b960', 'f04e1fc8-d275-42ec-a02b-2f7e3ab0b3c0', '5efc62c9-b7f4-4177-992e-c39e64817ddd'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:01:56 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:01:56 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:01:56 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.331s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:01:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Deleted volume successfully.
Sep 11 23:01:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-debdd3b9-4e15-4712-8b1c-345826dd9168 tempest-ServerRescueNegativeTestJSON-361153381 None] Lock "cinder-8fe0929e-15d6-4095-b62b-2925db84588b-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:02:06 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:02:06 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Flow 'volume_create_manager' (5c74a2a6-dac7-442d-a543-0f3754705074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4200b80-47e0-4656-a28c-c455a4490568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4200b80-47e0-4656-a28c-c455a4490568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-794291837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855f04e9-f8a5-4886-abdd-c80b76c0f701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86d7745bdf34aada3ea3bca22e69962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:34Z,use_quota=True,user_id='c05c23c7f2a34cd8b958037ab0b14e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a2933-4aa1-438d-9e7a-e5fe3a1271b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390a2933-4aa1-438d-9e7a-e5fe3a1271b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd16203-fcb5-43a9-9829-d557b11b3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd16203-fcb5-43a9-9829-d557b11b3faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855f04e9-f8a5-4886-abdd-c80b76c0f701', 'volume_name': 'volume-855f04e9-f8a5-4886-abdd-c80b76c0f701', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9b43d-ce01-4df9-8ba1-6cb3927211a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c9b43d-ce01-4df9-8ba1-6cb3927211a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a82529-6bc7-446d-8c78-2363fcbf66b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Volume 855f04e9-f8a5-4886-abdd-c80b76c0f701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855f04e9-f8a5-4886-abdd-c80b76c0f701', 'volume_size': 1}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-794291837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855f04e9-f8a5-4886-abdd-c80b76c0f701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b86d7745bdf34aada3ea3bca22e69962',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:34Z,use_quota=True,user_id='c05c23c7f2a34cd8b958037ab0b14e67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Creating volume 855f04e9-f8a5-4886-abdd-c80b76c0f701 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:02:33 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:02:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:02:33 devstack sudo[90275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 1073741824
Sep 11 23:02:33 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:02:34 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 1073741824" returned: 0 in 0.577s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:02:34 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701
Sep 11 23:02:34 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:02:34 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a82529-6bc7-446d-8c78-2363fcbf66b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855f04e9-f8a5-4886-abdd-c80b76c0f701', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6d90c-2487-48ad-87d0-a063b61dd37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Volume volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 (855f04e9-f8a5-4886-abdd-c80b76c0f701): created successfully
Sep 11 23:02:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb6d90c-2487-48ad-87d0-a063b61dd37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Flow 'volume_create_manager' (5c74a2a6-dac7-442d-a543-0f3754705074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:02:35 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0d150e34-91b6-4f88-a6c8-d0fa8caba32c tempest-TaggedAttachmentsTest-671179316 None] Created volume successfully.
Sep 11 23:02:44 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1,cinder:INSERT=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:02:45 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:02:46 devstack sudo[90342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:02:46 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Flow 'volume_create_manager' (c538cfe1-4267-4483-b53e-741acdd8ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f77459c-c0b7-4925-b041-bceff90a7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f77459c-c0b7-4925-b041-bceff90a7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-754649787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1844448-c74e-41f3-b826-0600bfd772a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f815b9f80d2b473da9f510ab181fbf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:46Z,use_quota=True,user_id='6006bb10560c41948ded0baa34216de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08074a2-5825-4afe-be2a-d678c85577b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08074a2-5825-4afe-be2a-d678c85577b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2035f726-a4a6-478a-baa9-e4b4c7215a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2035f726-a4a6-478a-baa9-e4b4c7215a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1844448-c74e-41f3-b826-0600bfd772a2', 'volume_name': 'volume-c1844448-c74e-41f3-b826-0600bfd772a2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94ad24c-fc15-4f92-955f-4ffd1c7f9839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94ad24c-fc15-4f92-955f-4ffd1c7f9839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff4d4f-623a-461a-91af-2f81301ff3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:46 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Volume c1844448-c74e-41f3-b826-0600bfd772a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1844448-c74e-41f3-b826-0600bfd772a2', 'volume_size': 1}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-754649787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1844448-c74e-41f3-b826-0600bfd772a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f815b9f80d2b473da9f510ab181fbf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:02:46Z,use_quota=True,user_id='6006bb10560c41948ded0baa34216de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Creating volume c1844448-c74e-41f3-b826-0600bfd772a2 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:02:46 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:02:46 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 1073741824
Sep 11 23:02:46 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:02:46 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:02:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:02:47 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 1073741824" returned: 0 in 0.728s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:02:47 devstack sudo[90359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2
Sep 11 23:02:47 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:02:47 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2" returned: 0 in 0.321s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff4d4f-623a-461a-91af-2f81301ff3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1844448-c74e-41f3-b826-0600bfd772a2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f854e-72f0-4606-81c9-0ab63f8c0e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:02:47 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Volume volume-c1844448-c74e-41f3-b826-0600bfd772a2 (c1844448-c74e-41f3-b826-0600bfd772a2): created successfully
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845f854e-72f0-4606-81c9-0ab63f8c0e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:02:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Flow 'volume_create_manager' (c538cfe1-4267-4483-b53e-741acdd8ad64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:02:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-aa8821a2-8a91-41f5-8b71-a7dd4cbf9156 tempest-ServerActionsTestOtherA-836573679 None] Created volume successfully.
Sep 11 23:02:57 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:02:57 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (7735c626-9e40-492c-8a05-87c33a2b3787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e324aa45-1f81-4eb3-be8b-da94055ff8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e324aa45-1f81-4eb3-be8b-da94055ff8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1240900295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74bee8e-fbf6-4d75-ba9c-e40f645f245a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:20Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56690be9-b196-4131-aa93-ac9a39a10fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56690be9-b196-4131-aa93-ac9a39a10fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5cb3b3-c1ee-4ad7-b8f1-1993a2e6afbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed5cb3b3-c1ee-4ad7-b8f1-1993a2e6afbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c74bee8e-fbf6-4d75-ba9c-e40f645f245a', 'volume_name': 'volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954bcd23-d9b2-4d5f-b848-729ff24ba60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954bcd23-d9b2-4d5f-b848-729ff24ba60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f7d1a-f957-45f2-9824-a5ebd8471fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Volume c74bee8e-fbf6-4d75-ba9c-e40f645f245a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a', 'volume_size': 1}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1240900295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74bee8e-fbf6-4d75-ba9c-e40f645f245a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:20Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Creating volume c74bee8e-fbf6-4d75-ba9c-e40f645f245a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:03:20 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:03:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:20 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a 1073741824
Sep 11 23:03:20 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:21 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a 1073741824" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:21 devstack sudo[90813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a
Sep 11 23:03:21 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:21 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313f7d1a-f957-45f2-9824-a5ebd8471fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff9ee8-6b4f-47b5-b7a0-3c15e0c941ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:21 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Volume volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a (c74bee8e-fbf6-4d75-ba9c-e40f645f245a): created successfully
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aff9ee8-6b4f-47b5-b7a0-3c15e0c941ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (7735c626-9e40-492c-8a05-87c33a2b3787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:03:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6519734c-2814-4b60-9f03-504ff645a64f tempest-AttachVolumeTestJSON-1190945035 None] Created volume successfully.
Sep 11 23:03:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ed2d7619-2a38-4938-a11e-c1983dd8f4c7 req-87f03023-0c87-4e38-8cf7-4592d7a4ebdc tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ed2d7619-2a38-4938-a11e-c1983dd8f4c7 req-87f03023-0c87-4e38-8cf7-4592d7a4ebdc tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ed2d7619-2a38-4938-a11e-c1983dd8f4c7 req-87f03023-0c87-4e38-8cf7-4592d7a4ebdc tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-ed2d7619-2a38-4938-a11e-c1983dd8f4c7 req-87f03023-0c87-4e38-8cf7-4592d7a4ebdc tempest-AttachVolumeTestJSON-1190945035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3acb135a-7b29-44bb-882d-5591ded4485e', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:03:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-ed2d7619-2a38-4938-a11e-c1983dd8f4c7 req-87f03023-0c87-4e38-8cf7-4592d7a4ebdc tempest-AttachVolumeTestJSON-1190945035 None] attachment_update completed successfully.
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Flow 'volume_create_manager' (8bf2fa9b-d7ef-4415-b4fa-50d8a6b3678a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e14a08-a88f-4f40-954e-e2756dcaaf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e14a08-a88f-4f40-954e-e2756dcaaf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2126501191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937a053fc3744dbdacd40a377a41b86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:27Z,use_quota=True,user_id='7b05f3753bfe49aeb81e16e9e568031e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a2e11f-38b5-4d71-860a-3cf321be1d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a2e11f-38b5-4d71-860a-3cf321be1d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be671a4-337d-4500-8dec-aa0257dfdb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be671a4-337d-4500-8dec-aa0257dfdb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd', 'volume_name': 'volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c40389-cab5-4ab9-9c68-c3874f2921b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c40389-cab5-4ab9-9c68-c3874f2921b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcabf5ad-72b3-406e-9e98-730a2b00fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Volume eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd', 'volume_size': 1}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2126501191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='937a053fc3744dbdacd40a377a41b86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:03:27Z,use_quota=True,user_id='7b05f3753bfe49aeb81e16e9e568031e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Creating volume eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:03:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:27 devstack sudo[91253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd 1073741824
Sep 11 23:03:27 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:27 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd 1073741824" returned: 0 in 0.547s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:27 devstack sudo[91261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd
Sep 11 23:03:27 devstack sudo[91261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:28 devstack sudo[91261]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcabf5ad-72b3-406e-9e98-730a2b00fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a91d05-2b13-48aa-aac6-9d689bc19b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:03:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Volume volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd (eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd): created successfully
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5a91d05-2b13-48aa-aac6-9d689bc19b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:03:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Flow 'volume_create_manager' (8bf2fa9b-d7ef-4415-b4fa-50d8a6b3678a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:03:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-65a96043-07c5-4246-a092-003063af235f tempest-AttachVolumeShelveTestJSON-1605852144 None] Created volume successfully.
Sep 11 23:03:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-219e4804-a8f7-43c3-bfd9-ccbe95da7fbc req-7121b964-ab92-436e-97ff-0ba07ef735d6 tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-219e4804-a8f7-43c3-bfd9-ccbe95da7fbc req-7121b964-ab92-436e-97ff-0ba07ef735d6 tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-219e4804-a8f7-43c3-bfd9-ccbe95da7fbc req-7121b964-ab92-436e-97ff-0ba07ef735d6 tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-219e4804-a8f7-43c3-bfd9-ccbe95da7fbc req-7121b964-ab92-436e-97ff-0ba07ef735d6 tempest-TaggedAttachmentsTest-671179316 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-855f04e9-f8a5-4886-abdd-c80b76c0f701', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be4f3a02-da6d-4b7e-9050-c6c06765584c', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:03:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-219e4804-a8f7-43c3-bfd9-ccbe95da7fbc req-7121b964-ab92-436e-97ff-0ba07ef735d6 tempest-TaggedAttachmentsTest-671179316 None] attachment_update completed successfully.
Sep 11 23:03:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-708f1268-c7b6-4cc2-a3f4-ea9f8ddd3587 req-19d9e576-0a8c-454d-874b-4cfa50274d11 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-708f1268-c7b6-4cc2-a3f4-ea9f8ddd3587 req-19d9e576-0a8c-454d-874b-4cfa50274d11 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-708f1268-c7b6-4cc2-a3f4-ea9f8ddd3587 req-19d9e576-0a8c-454d-874b-4cfa50274d11 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-708f1268-c7b6-4cc2-a3f4-ea9f8ddd3587 req-19d9e576-0a8c-454d-874b-4cfa50274d11 tempest-ServerActionsTestOtherA-836573679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-c1844448-c74e-41f3-b826-0600bfd772a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33b53f4d-fb68-44f5-bc8d-a3aad49011e0', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:03:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-708f1268-c7b6-4cc2-a3f4-ea9f8ddd3587 req-19d9e576-0a8c-454d-874b-4cfa50274d11 tempest-ServerActionsTestOtherA-836573679 None] attachment_update completed successfully.
Sep 11 23:03:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-2eeea610-2bde-411b-b39b-275222adc57b req-353161c1-681a-4045-9a90-55db97805dab tempest-TaggedAttachmentsTest-671179316 None] Terminate volume connection completed successfully.
Sep 11 23:03:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2eeea610-2bde-411b-b39b-275222adc57b req-353161c1-681a-4045-9a90-55db97805dab tempest-TaggedAttachmentsTest-671179316 None] Deleting attachment be4f3a02-da6d-4b7e-9050-c6c06765584c. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:03:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-74245ca5-8ac9-4d59-b4d2-13d0d89907cc tempest-ServerActionsTestOtherA-836573679 None] Terminate volume connection completed successfully.
Sep 11 23:03:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-74245ca5-8ac9-4d59-b4d2-13d0d89907cc tempest-ServerActionsTestOtherA-836573679 None] Deleting attachment 33b53f4d-fb68-44f5-bc8d-a3aad49011e0. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:03:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-38d77ad4-4c42-4176-9db9-22e1bf5bb463 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-38d77ad4-4c42-4176-9db9-22e1bf5bb463 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-38d77ad4-4c42-4176-9db9-22e1bf5bb463 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-38d77ad4-4c42-4176-9db9-22e1bf5bb463 tempest-ServerActionsTestOtherA-836573679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-c1844448-c74e-41f3-b826-0600bfd772a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acb0372c-a55c-4e57-9bd0-3fa422c7acdb', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:03:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-4f7eaa01-5286-46e6-814d-6137ac758721 req-38d77ad4-4c42-4176-9db9-22e1bf5bb463 tempest-ServerActionsTestOtherA-836573679 None] attachment_update completed successfully.
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:46 devstack sudo[92002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:03:46 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-677efac9-3184-4c42-9a56-52246cab33ba req-c9111361-5f6b-4946-8bd3-b02ebe4814b5 tempest-AttachVolumeShelveTestJSON-1605852144 None] No connector for attachment 79520442-67f1-4fd7-84aa-8875c99758ca; skipping storage backend terminate_connection call. {{(pid=88022) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-677efac9-3184-4c42-9a56-52246cab33ba req-c9111361-5f6b-4946-8bd3-b02ebe4814b5 tempest-AttachVolumeShelveTestJSON-1605852144 None] Deleting attachment 79520442-67f1-4fd7-84aa-8875c99758ca. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:03:46 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.426s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 8 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:03:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:03:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "cinder-855f04e9-f8a5-4886-abdd-c80b76c0f701-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:03:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "cinder-855f04e9-f8a5-4886-abdd-c80b76c0f701-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:03:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "cinder-quobyte-855f04e9-f8a5-4886-abdd-c80b76c0f701" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "cinder-quobyte-855f04e9-f8a5-4886-abdd-c80b76c0f701" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e9af7-07a7-49de-bd2c-cf4127d88d12]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:52 devstack sudo[92108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701
Sep 11 23:03:52 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:52 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701" returned: 0 in 0.496s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:52 devstack sudo[92113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701
Sep 11 23:03:52 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:52 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-855f04e9-f8a5-4886-abdd-c80b76c0f701" returned: 0 in 0.321s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "cinder-quobyte-855f04e9-f8a5-4886-abdd-c80b76c0f701" released by "delete_volume" :: held 0.873s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:03:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Created reservations ['bf7059d3-24ff-4d26-b8a7-842b3c7805c8', '2cc8e2dc-ef2b-4f28-978d-cded26743f1a', '4226492f-785f-4fdc-a024-17214a6afc07', '9f9eddb8-fde5-4e19-b1a7-86ddcfcf86d0'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:03:53 devstack sudo[92116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:03:53 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:03:53 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.605s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:03:53 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Deleted volume successfully.
Sep 11 23:03:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6d8b9698-ad3b-40b8-bd12-b361a8cda617 tempest-TaggedAttachmentsTest-671179316 None] Lock "cinder-855f04e9-f8a5-4886-abdd-c80b76c0f701-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:03:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-1ee74c95-26bc-41fb-9565-7c75f3af5ecd req-6a7b701f-83cf-4d5f-b434-63b3d870a2c0 tempest-AttachVolumeTestJSON-1190945035 None] Terminate volume connection completed successfully.
Sep 11 23:03:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-1ee74c95-26bc-41fb-9565-7c75f3af5ecd req-6a7b701f-83cf-4d5f-b434-63b3d870a2c0 tempest-AttachVolumeTestJSON-1190945035 None] Deleting attachment 3acb135a-7b29-44bb-882d-5591ded4485e. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:04:03 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=44,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:04:06 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=35,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:04:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-df652f3f-6b40-4ae2-9518-d55abfef3cd0 req-cc371504-429f-40b4-be10-605b1dbc657b tempest-ServerActionsTestOtherA-836573679 None] Terminate volume connection completed successfully.
Sep 11 23:04:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-df652f3f-6b40-4ae2-9518-d55abfef3cd0 req-cc371504-429f-40b4-be10-605b1dbc657b tempest-ServerActionsTestOtherA-836573679 None] Deleting attachment acb0372c-a55c-4e57-9bd0-3fa422c7acdb. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Flow 'volume_create_manager' (2c3ff6a6-65be-4cab-8138-ccae7f5b9579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b1f2a-05b5-44fd-9922-678295630fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698b1f2a-05b5-44fd-9922-678295630fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2145436377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7175d1-afeb-4139-bd50-8c3927b19b1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cbcddbae344ff1ac4312796cd5f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:14Z,use_quota=True,user_id='403a29bf78f0475592d35fd4ede2f79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f9e298-1b08-4989-9390-0205b91ed9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15f9e298-1b08-4989-9390-0205b91ed9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629f62a-c04e-4fe9-a25d-6f614a6985ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8629f62a-c04e-4fe9-a25d-6f614a6985ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7175d1-afeb-4139-bd50-8c3927b19b1e', 'volume_name': 'volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3a72ca-60ee-4c3e-a9bb-45d2f116134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3a72ca-60ee-4c3e-a9bb-45d2f116134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a39336d-343e-4f05-93cc-a166492601e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Volume 0a7175d1-afeb-4139-bd50-8c3927b19b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e', 'volume_size': 1}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2145436377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7175d1-afeb-4139-bd50-8c3927b19b1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c6cbcddbae344ff1ac4312796cd5f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:14Z,use_quota=True,user_id='403a29bf78f0475592d35fd4ede2f79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Creating volume 0a7175d1-afeb-4139-bd50-8c3927b19b1e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:04:14 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:04:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:14 devstack sudo[92407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e 1073741824
Sep 11 23:04:14 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:15 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e 1073741824" returned: 0 in 0.946s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:15 devstack sudo[92438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e
Sep 11 23:04:15 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:16 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e" returned: 0 in 0.634s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a39336d-343e-4f05-93cc-a166492601e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab467f9f-f29a-4df8-a930-d1cef2b28feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Volume volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e (0a7175d1-afeb-4139-bd50-8c3927b19b1e): created successfully
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab467f9f-f29a-4df8-a930-d1cef2b28feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Flow 'volume_create_manager' (2c3ff6a6-65be-4cab-8138-ccae7f5b9579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-2c3b9681-5199-4bc0-b68e-bbbcfa473ecc req-be1a2b98-d0aa-4af4-8085-54d87ab61dd2 tempest-VolumesGetTestJSON-436715083 None] Created volume successfully.
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Acquiring lock "cinder-0a7175d1-afeb-4139-bd50-8c3927b19b1e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "cinder-0a7175d1-afeb-4139-bd50-8c3927b19b1e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Acquiring lock "cinder-quobyte-0a7175d1-afeb-4139-bd50-8c3927b19b1e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "cinder-quobyte-0a7175d1-afeb-4139-bd50-8c3927b19b1e" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f26b266-fc7f-4d03-ba64-a180fe88e05b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:17 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e
Sep 11 23:04:17 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:17 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e" returned: 0 in 0.492s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:17 devstack sudo[92454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e
Sep 11 23:04:17 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:18 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0a7175d1-afeb-4139-bd50-8c3927b19b1e" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "cinder-quobyte-0a7175d1-afeb-4139-bd50-8c3927b19b1e" released by "delete_volume" :: held 0.804s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.quota [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Created reservations ['4d98bcd2-c5b8-40ac-8fc0-0a026b99ab71', '8a412f26-545d-45f6-896a-ed961982adb5', '5bf7266e-359c-43df-ba98-95277e1d8099', 'a26ee7da-714e-43c6-8886-3aadf6587327'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:18 devstack sudo[92457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:18 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:18 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.manager [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Deleted volume successfully.
Sep 11 23:04:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-0357ce22-40b0-446b-9948-50097dddea19 req-1fb151a5-ba10-401e-84e5-f7250a4142c2 tempest-VolumesGetTestJSON-436715083 None] Lock "cinder-0a7175d1-afeb-4139-bd50-8c3927b19b1e-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Flow 'volume_create_manager' (3581adeb-de9e-45b8-8103-af7f8beb8dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d3ee7-8cd6-4f22-8645-b5aaab05ddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291d3ee7-8cd6-4f22-8645-b5aaab05ddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2141852201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704d2695-622e-49af-93ea-72c236d876f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f815b9f80d2b473da9f510ab181fbf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:22Z,use_quota=True,user_id='6006bb10560c41948ded0baa34216de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dfebb7-f011-4f45-88e5-5a0301f819bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0dfebb7-f011-4f45-88e5-5a0301f819bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c736b0f-1068-441e-a63d-8e195185519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:21 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:04:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c736b0f-1068-441e-a63d-8e195185519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '704d2695-622e-49af-93ea-72c236d876f7', 'volume_name': 'volume-704d2695-622e-49af-93ea-72c236d876f7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdc093c320>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90283e3-491a-4f82-9aa8-8cf7cb05fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f90283e3-491a-4f82-9aa8-8cf7cb05fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34540a3f-9e87-4b30-9214-c1032c9c265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Volume 704d2695-622e-49af-93ea-72c236d876f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-704d2695-622e-49af-93ea-72c236d876f7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdc093c320>}
Sep 11 23:04:22 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Trying to clone 704d2695-622e-49af-93ea-72c236d876f7 from image 414d8567-5d24-440f-be04-3f648fa33a01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:04:23 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cf2023-aa7a-4802-8bd3-e3a39faaf32e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:23 devstack sudo[92493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD
Sep 11 23:04:23 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:23 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 is fetched for user 6006bb10560c41948ded0baa34216de5. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acbfe22-3aff-4384-9625-d1fea5f86739]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:24 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD
Sep 11 23:04:24 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:24 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2141852201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704d2695-622e-49af-93ea-72c236d876f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f815b9f80d2b473da9f510ab181fbf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:22Z,use_quota=True,user_id='6006bb10560c41948ded0baa34216de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Creating volume 704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:04:24 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:04:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9173be77-0be6-48a4-af67-3bfb0ef7703e tempest-GroupsTest-1040263072 None] Group tempest-Group1-1426907590: creating
Sep 11 23:04:24 devstack sudo[92505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1073741824
Sep 11 23:04:24 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9173be77-0be6-48a4-af67-3bfb0ef7703e tempest-GroupsTest-1040263072 None] Group tempest-Group1-1426907590: created successfully
Sep 11 23:04:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9173be77-0be6-48a4-af67-3bfb0ef7703e tempest-GroupsTest-1040263072 None] Create group completed successfully.
Sep 11 23:04:25 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1073741824" returned: 0 in 0.647s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:25 devstack sudo[92530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7
Sep 11 23:04:25 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:25 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Attempting download of 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 704d2695-622e-49af-93ea-72c236d876f7. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef24c98c-59ce-4b89-b372-0e7005d3c844]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:25 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3
Sep 11 23:04:25 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4a6c84e7-644f-45c6-a851-7b83a27b98ef tempest-GroupsTest-1040263072 None] Group tempest-Group2-457732862: creating
Sep 11 23:04:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4a6c84e7-644f-45c6-a851-7b83a27b98ef tempest-GroupsTest-1040263072 None] Group tempest-Group2-457732862: created successfully
Sep 11 23:04:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4a6c84e7-644f-45c6-a851-7b83a27b98ef tempest-GroupsTest-1040263072 None] Create group completed successfully.
Sep 11 23:04:25 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:25 devstack sudo[92544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3
Sep 11 23:04:25 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:26 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3" returned: 1 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_8saqa_x3' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[843bdc7d-9302-4c7f-b6de-7e72263aa7cf]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:26 devstack sudo[92549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD
Sep 11 23:04:26 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:26 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] 414d8567-5d24-440f-be04-3f648fa33a01 was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:04:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:26 devstack sudo[92555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7
Sep 11 23:04:26 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (f1e4773f-cd1a-44e5-b1b8-b1d9a6cf02e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f567e7b-9a0a-4d9a-9f01-6ef1a39c1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f567e7b-9a0a-4d9a-9f01-6ef1a39c1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2064043522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ccb352e1-c707-42e4-b2dd-7011b7811861,host='devstack@QuobyteHD#QuobyteHD',id=7383a480-8bc5-48d5-9752-bf7bff76bc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:27Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3998345a-1171-4d9f-8455-f638f7b17501),volume_type_id=3998345a-1171-4d9f-8455-f638f7b17501)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c61393-e18c-496f-910d-ee48b6114a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c61393-e18c-496f-910d-ee48b6114a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ae0399-db5e-406b-97b5-a74bb46c1834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ae0399-db5e-406b-97b5-a74bb46c1834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7383a480-8bc5-48d5-9752-bf7bff76bc9b', 'volume_name': 'volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0139eb59-bd82-4518-9a07-c70fcce1132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0139eb59-bd82-4518-9a07-c70fcce1132e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110f5205-35dd-411a-8ef6-f5115bded1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Volume 7383a480-8bc5-48d5-9752-bf7bff76bc9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b', 'volume_size': 1}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ccb352e1-c707-42e4-b2dd-7011b7811861,created_at=2026-09-11T21:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2064043522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ccb352e1-c707-42e4-b2dd-7011b7811861,host='devstack@QuobyteHD#QuobyteHD',id=7383a480-8bc5-48d5-9752-bf7bff76bc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:27Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3998345a-1171-4d9f-8455-f638f7b17501),volume_type_id=3998345a-1171-4d9f-8455-f638f7b17501)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Creating volume 7383a480-8bc5-48d5-9752-bf7bff76bc9b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:04:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:04:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:27 devstack sudo[92567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b 1073741824
Sep 11 23:04:27 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:28 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b 1073741824" returned: 0 in 0.566s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:28 devstack sudo[92573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b
Sep 11 23:04:28 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Acquiring lock "cinder-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "cinder-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Acquiring lock "cinder-quobyte-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "cinder-quobyte-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:28 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b" returned: 0 in 0.328s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292ea3c-8ae6-4963-a080-264da11417f2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110f5205-35dd-411a-8ef6-f5115bded1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f110913-9968-4f20-a98f-76e6fd904460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Volume volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b (7383a480-8bc5-48d5-9752-bf7bff76bc9b): created successfully
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f110913-9968-4f20-a98f-76e6fd904460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (f1e4773f-cd1a-44e5-b1b8-b1d9a6cf02e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9f27861b-9146-4baa-af2d-06e2494a519f tempest-GroupsTest-1040263072 None] Created volume successfully.
Sep 11 23:04:28 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd
Sep 11 23:04:28 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:28 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7" returned: 0 in 2.218s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_b5qg49p_devstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:04:28 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Converted 112.00 MB image at 50.49 MB/s
Sep 11 23:04:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:28 devstack sudo[92578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1G
Sep 11 23:04:28 devstack sudo[92578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:28 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" returned: 0 in 0.442s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:29 devstack sudo[92584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd
Sep 11 23:04:29 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:29 devstack sudo[92578]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 1G" returned: 0 in 0.409s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Downloaded image 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 704d2695-622e-49af-93ea-72c236d876f7 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 for user 6006bb10560c41948ded0baa34216de5 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Marking volume 704d2695-622e-49af-93ea-72c236d876f7 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Copying metadata from image 414d8567-5d24-440f-be04-3f648fa33a01 to 704d2695-622e-49af-93ea-72c236d876f7. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Creating volume glance metadata for volume 704d2695-622e-49af-93ea-72c236d876f7 backed by image 414d8567-5d24-440f-be04-3f648fa33a01 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:04:29 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" returned: 0 in 0.343s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "cinder-quobyte-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd" released by "delete_volume" :: held 0.839s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34540a3f-9e87-4b30-9214-c1032c9c265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704d2695-622e-49af-93ea-72c236d876f7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdc093c320>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e235690-7bd2-469d-bb01-e4eb119bc9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Volume volume-704d2695-622e-49af-93ea-72c236d876f7 (704d2695-622e-49af-93ea-72c236d876f7): created successfully
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e235690-7bd2-469d-bb01-e4eb119bc9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Flow 'volume_create_manager' (3581adeb-de9e-45b8-8103-af7f8beb8dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a7125d55-6c2a-4074-8ff5-6787128cd8aa tempest-ServerActionsTestOtherA-836573679 None] Created volume successfully.
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Created reservations ['efad8087-35ce-4c54-ac9c-c4a02e0e7dc6', '823caef2-0fce-48b9-9ccf-41d6e67dee17', '7d6b66c3-4031-4f3e-8adb-b02fc3185fa1', 'afdab665-fc18-4963-8e4b-f0198fa5e7ca'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:29 devstack sudo[92591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:29 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Acquiring lock "cinder-quobyte-7383a480-8bc5-48d5-9752-bf7bff76bc9b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-7383a480-8bc5-48d5-9752-bf7bff76bc9b" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[15922430-1513-4d2e-9a3a-c4748e909701]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:29 devstack sudo[92593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b
Sep 11 23:04:29 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:29 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.334s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Deleted volume successfully.
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a32f93fa-5100-40fa-9a8e-849c16380afb tempest-AttachVolumeShelveTestJSON-1605852144 None] Lock "cinder-eb6b11b4-a0f8-4415-a96b-7f9ebe413ddd-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:30 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b" returned: 0 in 0.408s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:30 devstack sudo[92599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b
Sep 11 23:04:30 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:30 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7383a480-8bc5-48d5-9752-bf7bff76bc9b" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-7383a480-8bc5-48d5-9752-bf7bff76bc9b" released by "delete_volume" :: held 0.743s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Created reservations ['b2d96eda-cd6b-4af1-816a-346912fc33cc'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:30 devstack cinder-volume[88022]: WARNING cinder.quota [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-992253401 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-992253401, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:04:30 devstack cinder-volume[88022]: WARNING cinder.quota [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-992253401 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-992253401, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Created reservations ['0e1dde4a-f77f-41d2-81f9-a29396c26351', '54ab0107-ca35-4c97-96a0-befc6fc5719e', '83f0eed9-bc41-47d3-a68d-9b287fee6334', 'a71db5f9-832f-4ccf-921f-47feaf8f3906'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:30 devstack sudo[92602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:30 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:31 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.333s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e3709ade-2226-4c83-a134-aa2215b5870b tempest-GroupsTest-1040263072 None] Delete group completed successfully.
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Created reservations ['d9d2f3dd-a1f8-4dde-a312-41d5f9c781e3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:31 devstack sudo[92608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:31 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:31 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.297s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:31 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d484d314-e22d-47e9-affa-b7e78f069e55 tempest-GroupsTest-1040263072 None] Delete group completed successfully.
Sep 11 23:04:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f115b88a-9fa0-493e-90c0-ef3bdea56df3 tempest-GroupsTest-1040263072 None] Group tempest-GroupsTest-Group-1332096271: creating
Sep 11 23:04:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-641084cc-979d-4419-8b67-bf785c35c2b3 req-e4124dcb-b53c-4258-8c33-9dff5e9469ce tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-641084cc-979d-4419-8b67-bf785c35c2b3 req-e4124dcb-b53c-4258-8c33-9dff5e9469ce tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f115b88a-9fa0-493e-90c0-ef3bdea56df3 tempest-GroupsTest-1040263072 None] Group tempest-GroupsTest-Group-1332096271: created successfully
Sep 11 23:04:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-641084cc-979d-4419-8b67-bf785c35c2b3 req-e4124dcb-b53c-4258-8c33-9dff5e9469ce tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f115b88a-9fa0-493e-90c0-ef3bdea56df3 tempest-GroupsTest-1040263072 None] Create group completed successfully.
Sep 11 23:04:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-641084cc-979d-4419-8b67-bf785c35c2b3 req-e4124dcb-b53c-4258-8c33-9dff5e9469ce tempest-ServerActionsTestOtherA-836573679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-704d2695-622e-49af-93ea-72c236d876f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b097ad8d-ba26-40be-966c-9f470e61b403', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:04:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-641084cc-979d-4419-8b67-bf785c35c2b3 req-e4124dcb-b53c-4258-8c33-9dff5e9469ce tempest-ServerActionsTestOtherA-836573679 None] attachment_update completed successfully.
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (9da78ce1-1f5f-4c6d-b645-081270d1089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d754bfb7-b108-4de5-8511-dfec53928f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d754bfb7-b108-4de5-8511-dfec53928f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215641553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=512bf16c-f350-4c37-b21d-b55eca129d51,host='devstack@QuobyteHD#QuobyteHD',id=0af289a5-2fed-47f1-b986-3ea11845fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:35Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f39141-4900-4a45-a6ec-8233ff434e58),volume_type_id=f2f39141-4900-4a45-a6ec-8233ff434e58)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7df0d4-c62b-4e45-9937-c07fe09af5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7df0d4-c62b-4e45-9937-c07fe09af5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e10492b-3d84-4502-957a-7b52e2094d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e10492b-3d84-4502-957a-7b52e2094d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af289a5-2fed-47f1-b986-3ea11845fc6b', 'volume_name': 'volume-0af289a5-2fed-47f1-b986-3ea11845fc6b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db40cd24-32b2-4897-8028-2b5b1ee372d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db40cd24-32b2-4897-8028-2b5b1ee372d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc74371c-13c6-4ece-af58-425ceb164f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:34 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Volume 0af289a5-2fed-47f1-b986-3ea11845fc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af289a5-2fed-47f1-b986-3ea11845fc6b', 'volume_size': 1}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=512bf16c-f350-4c37-b21d-b55eca129d51,created_at=2026-09-11T21:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1215641553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=512bf16c-f350-4c37-b21d-b55eca129d51,host='devstack@QuobyteHD#QuobyteHD',id=0af289a5-2fed-47f1-b986-3ea11845fc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:35Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f39141-4900-4a45-a6ec-8233ff434e58),volume_type_id=f2f39141-4900-4a45-a6ec-8233ff434e58)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Creating volume 0af289a5-2fed-47f1-b986-3ea11845fc6b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:04:34 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:04:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:34 devstack sudo[92623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b 1073741824
Sep 11 23:04:34 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:35 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b 1073741824" returned: 0 in 0.726s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:35 devstack sudo[92630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b
Sep 11 23:04:35 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:36 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc74371c-13c6-4ece-af58-425ceb164f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af289a5-2fed-47f1-b986-3ea11845fc6b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c25b6-1971-4b7c-86e6-e110d2671ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:36 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Volume volume-0af289a5-2fed-47f1-b986-3ea11845fc6b (0af289a5-2fed-47f1-b986-3ea11845fc6b): created successfully
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18c25b6-1971-4b7c-86e6-e110d2671ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (9da78ce1-1f5f-4c6d-b645-081270d1089c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0bd5e7a5-931c-4388-824a-cfdaac7861ef tempest-GroupsTest-1040263072 None] Created volume successfully.
Sep 11 23:04:37 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (34af29a9-9a9b-47c3-9403-ea575fbd4548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c0ebe7-d8d7-43e7-a238-9be05824f0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4c0ebe7-d8d7-43e7-a238-9be05824f0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634099900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=512bf16c-f350-4c37-b21d-b55eca129d51,host='devstack@QuobyteHD#QuobyteHD',id=7e903eeb-7918-4402-a8d5-50885c7e1df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:38Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f39141-4900-4a45-a6ec-8233ff434e58),volume_type_id=f2f39141-4900-4a45-a6ec-8233ff434e58)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a9bb1c-94a4-427c-9f30-50e3b030e026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a9bb1c-94a4-427c-9f30-50e3b030e026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d8a73a-b16d-434a-a8a0-e312be725605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d8a73a-b16d-434a-a8a0-e312be725605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e903eeb-7918-4402-a8d5-50885c7e1df2', 'volume_name': 'volume-7e903eeb-7918-4402-a8d5-50885c7e1df2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d3cbf8-2e6a-48b7-b8ba-b0d42cf6d085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d3cbf8-2e6a-48b7-b8ba-b0d42cf6d085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fa8e29-723a-4f50-8de2-c331bb7f579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Volume 7e903eeb-7918-4402-a8d5-50885c7e1df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e903eeb-7918-4402-a8d5-50885c7e1df2', 'volume_size': 1}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=512bf16c-f350-4c37-b21d-b55eca129d51,created_at=2026-09-11T21:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-634099900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=512bf16c-f350-4c37-b21d-b55eca129d51,host='devstack@QuobyteHD#QuobyteHD',id=7e903eeb-7918-4402-a8d5-50885c7e1df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9686178a21a497587472dafa99e88ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:04:38Z,use_quota=True,user_id='3db3598408af497a9c718942aba9105c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f2f39141-4900-4a45-a6ec-8233ff434e58),volume_type_id=f2f39141-4900-4a45-a6ec-8233ff434e58)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Creating volume 7e903eeb-7918-4402-a8d5-50885c7e1df2 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:04:38 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:38 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 1073741824
Sep 11 23:04:38 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:38 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 1073741824" returned: 0 in 0.710s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:38 devstack sudo[93061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2
Sep 11 23:04:38 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:39 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2" returned: 0 in 0.285s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fa8e29-723a-4f50-8de2-c331bb7f579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e903eeb-7918-4402-a8d5-50885c7e1df2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da884cb-3d6a-45f2-a17c-f01fc9628687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:04:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Volume volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 (7e903eeb-7918-4402-a8d5-50885c7e1df2): created successfully
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da884cb-3d6a-45f2-a17c-f01fc9628687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:04:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Flow 'volume_create_manager' (34af29a9-9a9b-47c3-9403-ea575fbd4548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:04:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1e1fb380-6875-4758-8fed-0ead93f44021 tempest-GroupsTest-1040263072 None] Created volume successfully.
Sep 11 23:04:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1be6319b-2a3e-49ae-9796-f70678ede7ee tempest-GroupsTest-1040263072 None] Update group completed successfully.
Sep 11 23:04:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0736d3ed-c200-4536-b4cc-365bb30200ab tempest-GroupsTest-1040263072 None] Update group completed successfully.
Sep 11 23:04:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Acquiring lock "cinder-quobyte-0af289a5-2fed-47f1-b986-3ea11845fc6b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-0af289a5-2fed-47f1-b986-3ea11845fc6b" acquired by "delete_volume" :: waited 0.053s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[102559d4-0e95-4f50-ae19-285c689d45b7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:45 devstack sudo[93100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b
Sep 11 23:04:45 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:46 devstack sudo[93103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:46 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:46 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b" returned: 0 in 0.806s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:46 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:46 devstack sudo[93109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b
Sep 11 23:04:46 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:04:46 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0af289a5-2fed-47f1-b986-3ea11845fc6b" returned: 0 in 0.557s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-0af289a5-2fed-47f1-b986-3ea11845fc6b" released by "delete_volume" :: held 1.486s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Acquiring lock "cinder-quobyte-7e903eeb-7918-4402-a8d5-50885c7e1df2" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-7e903eeb-7918-4402-a8d5-50885c7e1df2" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a671983-0360-4796-a523-45e602e6b3f9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:47 devstack sudo[93113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2
Sep 11 23:04:47 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:47 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2" returned: 0 in 0.681s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:47 devstack sudo[93119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2
Sep 11 23:04:47 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:48 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e903eeb-7918-4402-a8d5-50885c7e1df2" returned: 0 in 0.530s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "cinder-quobyte-7e903eeb-7918-4402-a8d5-50885c7e1df2" released by "delete_volume" :: held 1.300s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:04:48 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Created reservations ['4d531181-a843-43de-9b29-64a56295c07d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:48 devstack cinder-volume[88022]: WARNING cinder.quota [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-792035379 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-792035379, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:04:48 devstack cinder-volume[88022]: WARNING cinder.quota [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-792035379 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-792035379, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:04:48 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Created reservations ['032d1752-3338-4c26-8f51-0bab0bd3fd0f', '96460c16-dcd2-4790-a8a5-fd9a2aff04c4', '2bb987fa-c401-4385-b18b-2883f79295cf', 'afc9a599-da49-47ef-8edd-7126b4442132'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:48 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Created reservations ['98e2f26c-24ab-4367-8ca5-ad3ec70266a7', '0a425774-41d1-4472-bb88-96e27cf477ef', '4a5cfab3-99f6-40c9-8be7-d44934400fcc', '48f93698-dd76-4764-bc1c-c6fed81e0f28'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:04:49 devstack sudo[93133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:04:49 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:04:49 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:04:49 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:04:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2ac8e56b-5f5e-4174-8fc4-552ea5bbee72 tempest-GroupsTest-1040263072 None] Delete group completed successfully.
Sep 11 23:04:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-be6a9460-2f79-4247-9e69-c54ba3421f59 tempest-BackendsCapabilitiesAdminTestsJSON-973100301 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 23:04:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-85912184-6e2b-4678-9ca6-f92594e63677 tempest-BackendsCapabilitiesAdminTestsJSON-973100301 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 23:04:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-6f24224f-1b2a-46bb-bc42-6e11be11412a tempest-ServerActionsTestOtherA-836573679 None] Terminate volume connection completed successfully.
Sep 11 23:04:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-6f24224f-1b2a-46bb-bc42-6e11be11412a tempest-ServerActionsTestOtherA-836573679 None] Deleting attachment b097ad8d-ba26-40be-966c-9f470e61b403. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:04:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-c0844d6c-6c2f-45bd-bd4a-7b6276621a2e tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:04:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-c0844d6c-6c2f-45bd-bd4a-7b6276621a2e tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:04:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-c0844d6c-6c2f-45bd-bd4a-7b6276621a2e tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:04:53 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-c0844d6c-6c2f-45bd-bd4a-7b6276621a2e tempest-ServerActionsTestOtherA-836573679 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-704d2695-622e-49af-93ea-72c236d876f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a8962a5e-fe35-4fad-aac2-25445757dbf9', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:04:53 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-cf655073-58c2-453b-b796-45ffb03f6ed0 req-c0844d6c-6c2f-45bd-bd4a-7b6276621a2e tempest-ServerActionsTestOtherA-836573679 None] attachment_update completed successfully.
Sep 11 23:05:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10d84bc7-270d-4388-8ae1-a277cbe8dbb3 tempest-GroupSnapshotsV319Test-1124233719 None] Group tempest-GroupSnapshotsV319Test-Group-1036291147: creating
Sep 11 23:05:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10d84bc7-270d-4388-8ae1-a277cbe8dbb3 tempest-GroupSnapshotsV319Test-1124233719 None] Group tempest-GroupSnapshotsV319Test-Group-1036291147: created successfully
Sep 11 23:05:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10d84bc7-270d-4388-8ae1-a277cbe8dbb3 tempest-GroupSnapshotsV319Test-1124233719 None] Create group completed successfully.
Sep 11 23:05:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9174f949-3977-4a4b-a659-4df5e82d9ff7 tempest-GroupsV314Test-1918428830 None] Group tempest-GroupsV314Test-Group-975052327: creating
Sep 11 23:05:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9174f949-3977-4a4b-a659-4df5e82d9ff7 tempest-GroupsV314Test-1918428830 None] Group tempest-GroupsV314Test-Group-975052327: created successfully
Sep 11 23:05:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9174f949-3977-4a4b-a659-4df5e82d9ff7 tempest-GroupsV314Test-1918428830 None] Create group completed successfully.
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=82,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=19 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Flow 'volume_create_manager' (0bc1378d-787e-4fd3-9071-b8e53d26a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3323c7b1-e70c-424f-b60d-3ac1f24e8a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3323c7b1-e70c-424f-b60d-3ac1f24e8a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232335137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89ccabd5-39ee-4b4e-b090-9991ff4911fd,host='devstack@QuobyteHD#QuobyteHD',id=a627819f-1f4c-43d7-afa3-eb085604f3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95813a1488f4475b99dfb89c6497da13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:04Z,use_quota=True,user_id='069bc20d45ee4dc8928ce3728f621258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9628ac-e4eb-4ae4-8de5-3ff565815096),volume_type_id=bb9628ac-e4eb-4ae4-8de5-3ff565815096)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f19768-bf84-47bd-953f-bd1b6cca7079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f19768-bf84-47bd-953f-bd1b6cca7079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04032c0-b59f-420c-a4eb-6e232348d583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04032c0-b59f-420c-a4eb-6e232348d583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a627819f-1f4c-43d7-afa3-eb085604f3e7', 'volume_name': 'volume-a627819f-1f4c-43d7-afa3-eb085604f3e7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6ee98e-7657-4c3d-9199-732febf63298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6ee98e-7657-4c3d-9199-732febf63298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa50773-22f6-4e5a-bcd0-d481adc8be2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:04 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Volume a627819f-1f4c-43d7-afa3-eb085604f3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a627819f-1f4c-43d7-afa3-eb085604f3e7', 'volume_size': 1}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=89ccabd5-39ee-4b4e-b090-9991ff4911fd,created_at=2026-09-11T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232335137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=89ccabd5-39ee-4b4e-b090-9991ff4911fd,host='devstack@QuobyteHD#QuobyteHD',id=a627819f-1f4c-43d7-afa3-eb085604f3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95813a1488f4475b99dfb89c6497da13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:04Z,use_quota=True,user_id='069bc20d45ee4dc8928ce3728f621258',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb9628ac-e4eb-4ae4-8de5-3ff565815096),volume_type_id=bb9628ac-e4eb-4ae4-8de5-3ff565815096)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Creating volume a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:04 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:04 devstack sudo[93685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 1073741824
Sep 11 23:05:04 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:04 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Flow 'volume_create_manager' (556350d9-0816-4c00-86a4-adbff22b475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb31058-0777-4d7f-b27e-8414207395df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb31058-0777-4d7f-b27e-8414207395df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579623370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=18686cc7-b99a-49e0-a155-7a5231116367,host='devstack@QuobyteHD#QuobyteHD',id=2f1627e6-dfe2-4642-b443-e9b6fe4b30fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209a2832c26e4ef3a0c5a10e37758641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:05Z,use_quota=True,user_id='f8f4feda3d6042e2bd5e9ea2a1ce4ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da61b23e-5a45-464d-a65f-6b71e0ffc384),volume_type_id=da61b23e-5a45-464d-a65f-6b71e0ffc384)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415bd692-f4d8-4f28-aacd-5e77f91fb460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415bd692-f4d8-4f28-aacd-5e77f91fb460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991b8071-03c0-476a-9b10-360a847cfa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991b8071-03c0-476a-9b10-360a847cfa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1627e6-dfe2-4642-b443-e9b6fe4b30fb', 'volume_name': 'volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846dcdad-3c41-43a7-a9bf-9ad329bb9c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (846dcdad-3c41-43a7-a9bf-9ad329bb9c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05509f3f-8921-4910-862f-b3b72b9de3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:05 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Volume 2f1627e6-dfe2-4642-b443-e9b6fe4b30fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb', 'volume_size': 1}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:05 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 1073741824" returned: 0 in 1.054s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:05 devstack sudo[93742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7
Sep 11 23:05:05 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:06 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7" returned: 0 in 0.652s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=18686cc7-b99a-49e0-a155-7a5231116367,created_at=2026-09-11T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-579623370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=18686cc7-b99a-49e0-a155-7a5231116367,host='devstack@QuobyteHD#QuobyteHD',id=2f1627e6-dfe2-4642-b443-e9b6fe4b30fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='209a2832c26e4ef3a0c5a10e37758641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:05Z,use_quota=True,user_id='f8f4feda3d6042e2bd5e9ea2a1ce4ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da61b23e-5a45-464d-a65f-6b71e0ffc384),volume_type_id=da61b23e-5a45-464d-a65f-6b71e0ffc384)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Creating volume 2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:06 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=83,cinder:UPDATE=79,cinder:INSERT=22 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:05:06 devstack sudo[93757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb 1073741824
Sep 11 23:05:06 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa50773-22f6-4e5a-bcd0-d481adc8be2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a627819f-1f4c-43d7-afa3-eb085604f3e7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace7fb2f-e949-491d-ba87-b11a695c5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Volume volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 (a627819f-1f4c-43d7-afa3-eb085604f3e7): created successfully
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace7fb2f-e949-491d-ba87-b11a695c5287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Flow 'volume_create_manager' (0bc1378d-787e-4fd3-9071-b8e53d26a535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e4836403-3393-4cb3-a793-7c90bb5a08c0 tempest-GroupSnapshotsV319Test-1124233719 None] Created volume successfully.
Sep 11 23:05:07 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb 1073741824" returned: 0 in 0.902s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] GroupSnapshot 16dafe0a-856c-4475-b96b-5543145bec1e: creating.
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Group snapshot 16dafe0a-856c-4475-b96b-5543145bec1e: creating. {{(pid=88022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:07 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:07 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:07 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.359s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Creating offline snapshot f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 of volume a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05509f3f-8921-4910-862f-b3b72b9de3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2edcb4-415f-4e5a-8e45-6a896a817fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[807e0021-533f-42fe-8657-3ad110604f7c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Volume volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb (2f1627e6-dfe2-4642-b443-e9b6fe4b30fb): created successfully
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2edcb4-415f-4e5a-8e45-6a896a817fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Flow 'volume_create_manager' (556350d9-0816-4c00-86a4-adbff22b475c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-711e0691-74e9-4100-9cfd-5b0299e45bae tempest-GroupsV314Test-1918428830 None] Created volume successfully.
Sep 11 23:05:08 devstack sudo[93768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7
Sep 11 23:05:08 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:08 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7" returned: 0 in 0.457s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:08 devstack sudo[93774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 1G
Sep 11 23:05:08 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:08 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 1G" returned: 0 in 0.548s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:08 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7
Sep 11 23:05:08 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:09 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:09 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:05:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:09 devstack sudo[93786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7
Sep 11 23:05:09 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:09 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" returned: 0 in 0.381s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:09 devstack sudo[93789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info
Sep 11 23:05:09 devstack sudo[93789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:10 devstack sudo[93789]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info" returned: 0 in 0.465s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:10 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:10 devstack sudo[93793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info
Sep 11 23:05:10 devstack sudo[93793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:10 devstack sudo[93793]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.info" returned: 0 in 0.428s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.833s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.647s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Cloning volume 2f1627e6-dfe2-4642-b443-e9b6fe4b30fb to volume b48b953f-03a3-4b3a-bbb4-98f730bc427d
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Creating offline snapshot 6cef1249-5a1d-4c17-9611-581699a58519 of volume 2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9161a7ab-c946-426e-9b9b-cead731fdeb5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d955af92-a93a-449e-82c6-4a1c35075922 tempest-GroupSnapshotsV319Test-1124233719 None] group_snapshot 16dafe0a-856c-4475-b96b-5543145bec1e: created successfully
Sep 11 23:05:10 devstack sudo[93796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:10 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:11 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.429s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:11 devstack sudo[93801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 1G
Sep 11 23:05:11 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:11 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 1G" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:11 devstack sudo[93807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:11 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:12 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:12 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:12 devstack sudo[93813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:12 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:12 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.273s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] group_snapshot 16dafe0a-856c-4475-b96b-5543145bec1e: deleting
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:12 devstack sudo[93816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info
Sep 11 23:05:12 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] group_snapshot 16dafe0a-856c-4475-b96b-5543145bec1e: deleting {{(pid=88022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "cinder-quobyte-f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Deleting offline snapshot f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 of volume a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] snapshot_file for this snap is: volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d9141-b5b8-4893-a4b0-d4fd502f2af8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:12 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:12 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:05:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:12 devstack sudo[93819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7
Sep 11 23:05:12 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:12 devstack sudo[93821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info
Sep 11 23:05:12 devstack sudo[93821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:13 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:13 devstack sudo[93821]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" returned: 0 in 0.505s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a627819f-1f4c-43d7-afa3-eb085604f3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.info" returned: 0 in 0.384s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Acquiring lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd43204-c180-42c8-953b-2731c8193fcd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] snapshot: 6cef1249-5a1d-4c17-9611-581699a58519, volume: b48b953f-03a3-4b3a-bbb4-98f730bc427d,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce76a30-6c25-4c82-8a87-92e87ed1962f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:13 devstack sudo[93828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7
Sep 11 23:05:13 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:13 devstack sudo[93829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:13 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:13 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7" returned: 0 in 0.429s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:13 devstack sudo[93835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7
Sep 11 23:05:13 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:13 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.480s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86d4fd-44cb-43f9-a07f-e37dca9a4a03]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:13 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:13 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:14 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:14 devstack sudo[93847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7
Sep 11 23:05:14 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:14 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.532s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:14 devstack sudo[93877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d
Sep 11 23:05:14 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:14 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7.f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-f69cd140-5cd4-4884-ab9b-ae10e6ca64c7" released by "_delete_snapshot" :: held 1.889s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" released by "delete_snapshot" :: held 1.924s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:14 devstack cinder-volume[88022]: WARNING cinder.quota [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1056441610 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1056441610, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:14 devstack cinder-volume[88022]: WARNING cinder.quota [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1056441610 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1056441610, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:14 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] Created reservations ['969b8ecd-63dd-4de8-a134-fa7d5aac64cd', '7bfe8b8a-00c9-4989-ba8b-f0109f75925a', '1844318f-b53a-4f54-b213-2e64c45ad3bd', '1b91ae76-b084-466a-868f-9c999962493a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9a0f860a-a5b5-499a-b1d0-c595b7e137d5 tempest-GroupSnapshotsV319Test-1124233719 None] group_snapshot 16dafe0a-856c-4475-b96b-5543145bec1e: deleted successfully
Sep 11 23:05:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" acquired by "delete_volume" :: waited 0.057s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:15 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60cb79c-3569-4678-9f31-fcde62bfc1f5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:15 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7
Sep 11 23:05:15 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:16 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7" returned: 0 in 0.900s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:16 devstack sudo[93915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7
Sep 11 23:05:16 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:17 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a627819f-1f4c-43d7-afa3-eb085604f3e7" returned: 0 in 0.769s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "cinder-quobyte-a627819f-1f4c-43d7-afa3-eb085604f3e7" released by "delete_volume" :: held 2.003s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:17 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Created reservations ['fa0caf9a-c3c0-4e9c-bf60-c69f0ffa1c7d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:17 devstack cinder-volume[88022]: WARNING cinder.quota [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1056441610 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1056441610, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:17 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Created reservations ['3027c2a4-8068-4813-8b30-e6de99639976', 'd085813f-b1eb-4702-9381-86857c53e367', '46086b26-9784-4cf4-a864-e1d106052736', '3c68401c-2a0c-4f0a-9461-a119ac6a9bbc'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:18 devstack sudo[93926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:18 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:18 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.523s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:18 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c51c6bd8-9263-43ec-a2cf-1256a4d97ad7 tempest-GroupSnapshotsV319Test-1124233719 None] Delete group completed successfully.
Sep 11 23:05:21 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d" returned: 0 in 7.241s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:05:21 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Converted 1024.00 MB image at 141.40 MB/s
Sep 11 23:05:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:21 devstack sudo[93950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d
Sep 11 23:05:21 devstack sudo[93950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:21 devstack sudo[93950]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" released by "_copy_volume_from_snapshot" :: held 8.582s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Acquiring lock "cinder-quobyte-6cef1249-5a1d-4c17-9611-581699a58519" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-6cef1249-5a1d-4c17-9611-581699a58519" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Deleting offline snapshot 6cef1249-5a1d-4c17-9611-581699a58519 of volume 2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] snapshot_file for this snap is: volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[147cdbe9-639d-4d36-b9fb-8a270fb0bbf0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:22 devstack sudo[93953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:22 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:22 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.395s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4bbe79-d41b-4e3c-aca7-505c5fac9166]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:22 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:22 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:22 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.556s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:22 devstack sudo[93964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:22 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:23 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.366s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:23 devstack sudo[93972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519
Sep 11 23:05:23 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:23 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb.6cef1249-5a1d-4c17-9611-581699a58519" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-6cef1249-5a1d-4c17-9611-581699a58519" released by "_delete_snapshot" :: held 1.772s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.986s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1e823e2c-3398-4edc-9fa6-5e579d50be38 tempest-GroupsV314Test-1918428830 None] Create group from source-group-18686cc7-b99a-49e0-a155-7a5231116367 completed successfully.
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Acquiring lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd91d1b-8f8f-4197-8215-c5aadeb9f100]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:25 devstack sudo[93979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d
Sep 11 23:05:25 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:25 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d" returned: 0 in 0.408s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:25 devstack sudo[93990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d
Sep 11 23:05:25 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:25 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b48b953f-03a3-4b3a-bbb4-98f730bc427d" returned: 0 in 0.277s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-b48b953f-03a3-4b3a-bbb4-98f730bc427d" released by "delete_volume" :: held 0.736s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Created reservations ['07226a2e-effe-4697-8559-494eb57d3c70'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:26 devstack cinder-volume[88022]: WARNING cinder.quota [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-461190156 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-461190156, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:26 devstack cinder-volume[88022]: WARNING cinder.quota [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-461190156 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-461190156, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Created reservations ['c72df83c-6c02-4aa2-b18d-e9b919775fb1', '0e7ad4a3-5842-40fa-8a20-78f94e242c77', '4fb7b386-fef7-4c46-9f07-14b491e630e1', '88be3175-1843-4508-8ef3-eb743e931143'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:26 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:26 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:26 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-062c6d42-c5a8-4f6e-9764-5f55fac899d5 tempest-GroupsV320Test-305354246 None] Group tempest-GroupsV320Test-Group-822631833: creating
Sep 11 23:05:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d26cd61c-f6d9-48cc-9ffe-ac56e47bcea9 tempest-GroupsV314Test-1918428830 None] Delete group completed successfully.
Sep 11 23:05:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-062c6d42-c5a8-4f6e-9764-5f55fac899d5 tempest-GroupsV320Test-305354246 None] Group tempest-GroupsV320Test-Group-822631833: created successfully
Sep 11 23:05:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-062c6d42-c5a8-4f6e-9764-5f55fac899d5 tempest-GroupsV320Test-305354246 None] Create group completed successfully.
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Acquiring lock "cinder-quobyte-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f935e0d-3950-4cf9-b8a3-9868befe8b51]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:27 devstack sudo[93998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:27 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:27 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:27 devstack sudo[94008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb
Sep 11 23:05:27 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:27 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Lock "cinder-quobyte-2f1627e6-dfe2-4642-b443-e9b6fe4b30fb" released by "delete_volume" :: held 0.860s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Created reservations ['25c65978-884a-4e80-bb28-e146615ac9ce'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Created reservations ['e273cfe1-0099-44a5-8eec-6e0c9607118e', '4b7a2453-938c-44d3-bec9-4ee5791229c9', 'b7d52e1a-bdd0-49f2-8380-c18f663ef32f', 'f6914d97-7a66-4fab-b835-d7214888e9db'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:28 devstack sudo[94032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:28 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:28 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.608s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-47521428-1c55-4e09-b107-65494c00b5f2 tempest-GroupsV314Test-1918428830 None] Delete group completed successfully.
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Created reservations ['c3535dfc-7b21-44b6-95f2-6fd4e1b41536'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:28 devstack sudo[94036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:28 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:29 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d93641ca-61af-4dfb-8070-d543d9164b08 tempest-GroupsV320Test-305354246 None] Delete group completed successfully.
Sep 11 23:05:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-90eaf87a-458e-4d13-873f-ed27a55ae71e tempest-ServerActionsTestOtherA-836573679 None] Terminate volume connection completed successfully.
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-90eaf87a-458e-4d13-873f-ed27a55ae71e tempest-ServerActionsTestOtherA-836573679 None] Deleting attachment a8962a5e-fe35-4fad-aac2-25445757dbf9. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "cinder-704d2695-622e-49af-93ea-72c236d876f7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-704d2695-622e-49af-93ea-72c236d876f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "cinder-quobyte-704d2695-622e-49af-93ea-72c236d876f7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-quobyte-704d2695-622e-49af-93ea-72c236d876f7" acquired by "delete_volume" :: waited 0.044s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6041ade8-90fc-4b6b-89f1-0bacc42cab63]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:30 devstack sudo[94041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7
Sep 11 23:05:30 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:30 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7" returned: 0 in 0.666s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:30 devstack sudo[94046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7
Sep 11 23:05:30 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:30 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-704d2695-622e-49af-93ea-72c236d876f7" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-quobyte-704d2695-622e-49af-93ea-72c236d876f7" released by "delete_volume" :: held 1.072s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:30 devstack cinder-volume[88022]: DEBUG cinder.quota [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Created reservations ['46a58592-83aa-4528-b988-ffa5ebabe715', '786b812e-24ae-4d1a-ae88-896266544344', 'c5f113cf-3305-4a6a-95cc-ca4cd278c62a', '8171ef2b-ec35-49d2-b109-85de760d4d24'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:31 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:31 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:31 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.manager [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Deleted volume successfully.
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-74e0429f-0a1f-4663-add7-79efe6907f0d req-906814ed-9c77-4b99-8434-8b4b55a07a69 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-704d2695-622e-49af-93ea-72c236d876f7-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "cinder-c1844448-c74e-41f3-b826-0600bfd772a2-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-c1844448-c74e-41f3-b826-0600bfd772a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "cinder-quobyte-c1844448-c74e-41f3-b826-0600bfd772a2" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-quobyte-c1844448-c74e-41f3-b826-0600bfd772a2" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcd6071-8b07-4264-ae0b-1f1860cf837d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:32 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2
Sep 11 23:05:32 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:32 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2" returned: 0 in 0.554s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:32 devstack sudo[94059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2
Sep 11 23:05:32 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:32 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (62bdde2b-41da-4f17-8753-636728e058c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0156dc-c54c-445c-9437-2ceeaa8a2541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c1844448-c74e-41f3-b826-0600bfd772a2" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0156dc-c54c-445c-9437-2ceeaa8a2541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220023798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45864da5-94d5-4a81-ac23-369a428abf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:33Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1aa8d-9737-40af-b544-4feb9c3ed62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf1aa8d-9737-40af-b544-4feb9c3ed62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2939442-27fa-4d44-8339-aea9c419d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2939442-27fa-4d44-8339-aea9c419d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45864da5-94d5-4a81-ac23-369a428abf34', 'volume_name': 'volume-45864da5-94d5-4a81-ac23-369a428abf34', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a70ffd-e63d-43a6-abe5-590fba01981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a70ffd-e63d-43a6-abe5-590fba01981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783853a4-3d28-4775-a53e-0c04392c4321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Volume 45864da5-94d5-4a81-ac23-369a428abf34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45864da5-94d5-4a81-ac23-369a428abf34', 'volume_size': 1}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220023798',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45864da5-94d5-4a81-ac23-369a428abf34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:33Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Creating volume 45864da5-94d5-4a81-ac23-369a428abf34 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:32 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-quobyte-c1844448-c74e-41f3-b826-0600bfd772a2" released by "delete_volume" :: held 1.077s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:33 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 1073741824
Sep 11 23:05:33 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Created reservations ['9a2e74f6-7a56-496d-9c5b-1f3c1b7d14fc', '9e8aa342-dd3b-481a-90e1-00443d3be474', '5582952b-2a8a-49c7-83a0-2175d4b06b8c', '347dcba7-d95d-4532-a171-a381fa6c31ee'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:33 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:33 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:33 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.342s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Deleted volume successfully.
Sep 11 23:05:33 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 1073741824" returned: 0 in 0.567s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9ed5fd9d-0849-46e8-a4d8-6389d7b28495 tempest-ServerActionsTestOtherA-836573679 None] Lock "cinder-c1844448-c74e-41f3-b826-0600bfd772a2-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:33 devstack sudo[94071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34
Sep 11 23:05:33 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:33 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783853a4-3d28-4775-a53e-0c04392c4321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45864da5-94d5-4a81-ac23-369a428abf34', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa8c9a3-0466-4b3b-9d26-cd20cc1cfda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Volume volume-45864da5-94d5-4a81-ac23-369a428abf34 (45864da5-94d5-4a81-ac23-369a428abf34): created successfully
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa8c9a3-0466-4b3b-9d26-cd20cc1cfda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (62bdde2b-41da-4f17-8753-636728e058c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d1eb79f6-94aa-415d-875a-dd577a20f9ba tempest-AttachVolumeTestJSON-1190945035 None] Created volume successfully.
Sep 11 23:05:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0466ee44-bade-49d3-abc3-3a57649da5eb req-71ad3bf1-81a3-4f9f-8bd3-77a592159100 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0466ee44-bade-49d3-abc3-3a57649da5eb req-71ad3bf1-81a3-4f9f-8bd3-77a592159100 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0466ee44-bade-49d3-abc3-3a57649da5eb req-71ad3bf1-81a3-4f9f-8bd3-77a592159100 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-0466ee44-bade-49d3-abc3-3a57649da5eb req-71ad3bf1-81a3-4f9f-8bd3-77a592159100 tempest-AttachVolumeTestJSON-1190945035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-45864da5-94d5-4a81-ac23-369a428abf34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82a60304-52bc-4149-b002-618d9aa2e47f', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:05:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-0466ee44-bade-49d3-abc3-3a57649da5eb req-71ad3bf1-81a3-4f9f-8bd3-77a592159100 tempest-AttachVolumeTestJSON-1190945035 None] attachment_update completed successfully.
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (bcd12dd7-2e1a-4a82-8f19-36e7fce458de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7950343-b6f2-4c88-8c91-2c144658977e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7950343-b6f2-4c88-8c91-2c144658977e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-459879983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6214d96c-f395-49ce-b05a-84cb5caa0f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83413589-0a57-4155-b0cc-63cf86758041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83413589-0a57-4155-b0cc-63cf86758041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8cb4e7-166a-4878-94bb-b1051f70012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a8cb4e7-166a-4878-94bb-b1051f70012e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6214d96c-f395-49ce-b05a-84cb5caa0f88', 'volume_name': 'volume-6214d96c-f395-49ce-b05a-84cb5caa0f88', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af95088a-1f34-4440-8b68-3b41362b50c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af95088a-1f34-4440-8b68-3b41362b50c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a70ffe4-4f40-4dd0-a38b-72aeb3de3a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Volume 6214d96c-f395-49ce-b05a-84cb5caa0f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6214d96c-f395-49ce-b05a-84cb5caa0f88', 'volume_size': 1}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-459879983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6214d96c-f395-49ce-b05a-84cb5caa0f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822b62523ca54ef7a4097c0c052310f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='83de30ca2e0a4bd09ea7b51c041ca877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Creating volume 6214d96c-f395-49ce-b05a-84cb5caa0f88 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:38 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:39 devstack sudo[94495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 1073741824
Sep 11 23:05:39 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Flow 'volume_create_manager' (1b27217b-c602-41a7-872d-a00561c0909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd8224-3a9d-4995-b64e-7130b94b7dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd8224-3a9d-4995-b64e-7130b94b7dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1950765772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b37035a-b963-457d-9a78-750ab02258f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0229ace6fd7a45cd98e11f141c7a2d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='58cc37cbd7b149e2af75a1bc93730780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d70c24-2622-4dbc-974c-f9cf6b265d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d70c24-2622-4dbc-974c-f9cf6b265d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f80f08-6018-40da-a201-7a25ff5251b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f80f08-6018-40da-a201-7a25ff5251b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b37035a-b963-457d-9a78-750ab02258f3', 'volume_name': 'volume-5b37035a-b963-457d-9a78-750ab02258f3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27b5f4c-356c-4b32-a4a9-ac64edae472e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f27b5f4c-356c-4b32-a4a9-ac64edae472e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38be8814-466c-45bf-89e5-cd5760bff0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Volume 5b37035a-b963-457d-9a78-750ab02258f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b37035a-b963-457d-9a78-750ab02258f3', 'volume_size': 1}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:39 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 1073741824" returned: 0 in 0.522s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:39 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88
Sep 11 23:05:39 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:39 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1950765772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b37035a-b963-457d-9a78-750ab02258f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0229ace6fd7a45cd98e11f141c7a2d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:39Z,use_quota=True,user_id='58cc37cbd7b149e2af75a1bc93730780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Creating volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:39 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:39 devstack sudo[94505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 1073741824
Sep 11 23:05:39 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a70ffe4-4f40-4dd0-a38b-72aeb3de3a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6214d96c-f395-49ce-b05a-84cb5caa0f88', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e87383-96ae-4b76-a4a7-c4493545466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Volume volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 (6214d96c-f395-49ce-b05a-84cb5caa0f88): created successfully
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e87383-96ae-4b76-a4a7-c4493545466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Flow 'volume_create_manager' (bcd12dd7-2e1a-4a82-8f19-36e7fce458de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-13d4f035-906b-4999-977e-67c6b8bfa1f9 tempest-AttachVolumeTestJSON-1190945035 None] Created volume successfully.
Sep 11 23:05:40 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 1073741824" returned: 0 in 0.500s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:40 devstack sudo[94511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3
Sep 11 23:05:40 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:40 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3" returned: 0 in 0.292s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38be8814-466c-45bf-89e5-cd5760bff0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b37035a-b963-457d-9a78-750ab02258f3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320e6f0d-bc23-4c4a-8a48-9274ad0a582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Volume volume-5b37035a-b963-457d-9a78-750ab02258f3 (5b37035a-b963-457d-9a78-750ab02258f3): created successfully
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320e6f0d-bc23-4c4a-8a48-9274ad0a582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Flow 'volume_create_manager' (1b27217b-c602-41a7-872d-a00561c0909f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1f699676-df4d-439f-8bcc-b9cb248d88c7 tempest-SnapshotsActionsTest-1728848519 None] Created volume successfully.
Sep 11 23:05:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a88d3f13-22c1-4fef-8d0d-a6d8b14110b3 req-87757791-1554-4551-9dc9-d24e8333f676 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a88d3f13-22c1-4fef-8d0d-a6d8b14110b3 req-87757791-1554-4551-9dc9-d24e8333f676 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a88d3f13-22c1-4fef-8d0d-a6d8b14110b3 req-87757791-1554-4551-9dc9-d24e8333f676 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-a88d3f13-22c1-4fef-8d0d-a6d8b14110b3 req-87757791-1554-4551-9dc9-d24e8333f676 tempest-AttachVolumeTestJSON-1190945035 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-6214d96c-f395-49ce-b05a-84cb5caa0f88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c87e1b7-b7e2-4c31-bbf7-603752e1bf56', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:05:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-a88d3f13-22c1-4fef-8d0d-a6d8b14110b3 req-87757791-1554-4551-9dc9-d24e8333f676 tempest-AttachVolumeTestJSON-1190945035 None] attachment_update completed successfully.
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Creating offline snapshot 91403486-2de3-4ee1-9508-cbef3c35dc67 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a0a2a-d01e-41a9-b63e-4e07b3a8dc8d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:42 devstack sudo[94531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3
Sep 11 23:05:42 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:42 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3" returned: 0 in 0.420s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:42 devstack sudo[94539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 1G
Sep 11 23:05:42 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:43 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 1G" returned: 0 in 0.609s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:43 devstack sudo[94548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:43 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-8ec0d371-a897-41b0-88df-9cee9460afa0 req-ee9d106e-4367-437a-afe5-91f37ce0029b tempest-AttachVolumeTestJSON-1190945035 None] Terminate volume connection completed successfully.
Sep 11 23:05:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-8ec0d371-a897-41b0-88df-9cee9460afa0 req-ee9d106e-4367-437a-afe5-91f37ce0029b tempest-AttachVolumeTestJSON-1190945035 None] Deleting attachment 82a60304-52bc-4149-b002-618d9aa2e47f. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:05:43 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.371s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:43 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 is being set with open permissions: ugo+rw
Sep 11 23:05:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:43 devstack sudo[94555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:43 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:44 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:44 devstack sudo[94558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info
Sep 11 23:05:44 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:44 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info" returned: 0 in 0.349s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:44 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info is being set with open permissions: ugo+rw
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:44 devstack sudo[94562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info
Sep 11 23:05:44 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:44 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.info" returned: 0 in 0.361s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-be4a44b9-953c-46d0-89ac-ca8816a18d2c tempest-SnapshotsActionsTest-1728848519 None] Create snapshot completed successfully
Sep 11 23:05:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-7caf5f94-ff28-4d6b-a219-d32e93c62117 req-9f1bd48e-2938-4226-9705-03af90d4b1f8 tempest-AttachVolumeTestJSON-1190945035 None] Terminate volume connection completed successfully.
Sep 11 23:05:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-7caf5f94-ff28-4d6b-a219-d32e93c62117 req-9f1bd48e-2938-4226-9705-03af90d4b1f8 tempest-AttachVolumeTestJSON-1190945035 None] Deleting attachment 1c87e1b7-b7e2-4c31-bbf7-603752e1bf56. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:46 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:46 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:46 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.431s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Creating offline snapshot f8a6fdd4-3691-44af-ae3e-0b256c9adda0 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3eae798-b92a-4555-89cf-dd1ccb226377]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:46 devstack sudo[94597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:46 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:47 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.587s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:47 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 1G
Sep 11 23:05:47 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:47 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 1G" returned: 0 in 0.664s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:47 devstack sudo[94629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0
Sep 11 23:05:47 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:48 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0" returned: 0 in 0.511s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:48 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 is being set with open permissions: ugo+rw
Sep 11 23:05:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:48 devstack sudo[94636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0
Sep 11 23:05:48 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:48 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cb4e0fb7-1be1-49b3-b540-78fd6dbaa118 tempest-SnapshotsActionsTest-1728848519 None] Create snapshot completed successfully
Sep 11 23:05:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-f8a6fdd4-3691-44af-ae3e-0b256c9adda0-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-f8a6fdd4-3691-44af-ae3e-0b256c9adda0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-f8a6fdd4-3691-44af-ae3e-0b256c9adda0" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-f8a6fdd4-3691-44af-ae3e-0b256c9adda0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Deleting offline snapshot f8a6fdd4-3691-44af-ae3e-0b256c9adda0 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] snapshot_file for this snap is: volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad714f36-1e2c-4c6a-b591-83d0971a42df]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:50 devstack sudo[94641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0
Sep 11 23:05:50 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:50 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0" returned: 0 in 0.448s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f49a2-d3a4-49e5-8a29-4e7c5ca84f92]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:50 devstack sudo[94647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:50 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:51 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.490s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:51 devstack sudo[94652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0
Sep 11 23:05:51 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:51 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0" returned: 0 in 0.592s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:51 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0
Sep 11 23:05:51 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:52 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.f8a6fdd4-3691-44af-ae3e-0b256c9adda0" returned: 0 in 0.412s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-f8a6fdd4-3691-44af-ae3e-0b256c9adda0" released by "_delete_snapshot" :: held 2.097s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_snapshot" :: held 2.134s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:52 devstack cinder-volume[88022]: WARNING cinder.quota [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Created reservations ['6a8267b2-9e13-48e9-9749-6332c044f7ba', '7bd125fa-00e9-4315-b62f-ba004b04b67e', 'bfb94187-3876-48cf-b6f7-14ae3147f63d', '3e852172-d032-4d17-939c-0053dc8b2a12'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Delete snapshot completed successfully.
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c4747a1-c829-426f-8889-67a7bed342b5 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-f8a6fdd4-3691-44af-ae3e-0b256c9adda0-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-6214d96c-f395-49ce-b05a-84cb5caa0f88-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-6214d96c-f395-49ce-b05a-84cb5caa0f88-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-quobyte-6214d96c-f395-49ce-b05a-84cb5caa0f88" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-6214d96c-f395-49ce-b05a-84cb5caa0f88" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967732d-287b-4f5d-b8f0-24845f8a7269]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:52 devstack sudo[94661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88
Sep 11 23:05:52 devstack sudo[94661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:53 devstack sudo[94661]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88" returned: 0 in 0.447s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:53 devstack sudo[94666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88
Sep 11 23:05:53 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:53 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6214d96c-f395-49ce-b05a-84cb5caa0f88" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-6214d96c-f395-49ce-b05a-84cb5caa0f88" released by "delete_volume" :: held 0.971s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Creating offline snapshot cf7bac70-9533-415f-a508-20322c032244 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[330fd468-8c36-4926-9c11-0397bdb42008]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Created reservations ['3182e1cc-76e8-4053-a697-5bf82eeca688', 'df06492c-4309-4007-8d37-4bd44b7428df', 'b9f6ddcf-1586-484a-855d-df7e7696b187', 'ef7e3909-e56b-4224-a7c8-3383f4ed92be'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:53 devstack sudo[94669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:53 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:53 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:53 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:54 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Deleted volume successfully.
Sep 11 23:05:54 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3407335-cb5e-456e-93a7-34a3502f6070 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-6214d96c-f395-49ce-b05a-84cb5caa0f88-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.572s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:54 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 1G
Sep 11 23:05:54 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Flow 'volume_create_manager' (9081c723-5074-4fa8-baeb-5626bbaaea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163e0866-dcde-48d4-a256-049a21d0e679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163e0866-dcde-48d4-a256-049a21d0e679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317094914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26784e1a-3ec4-4743-b660-8e9cbdd05f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a01b3fc70f41bd984ed5e5344397a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:54Z,use_quota=True,user_id='805f67d1c92c4577965832c410979060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f686d8ab-47e7-49a5-970e-68d3e967fc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f686d8ab-47e7-49a5-970e-68d3e967fc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ad7563-ca2b-482f-a843-e6118d830dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ad7563-ca2b-482f-a843-e6118d830dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26784e1a-3ec4-4743-b660-8e9cbdd05f3b', 'volume_name': 'volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed260a55-0734-4dbc-b029-ba488467904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed260a55-0734-4dbc-b029-ba488467904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517c3027-55d4-4277-84a4-49db111542bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:54 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume 26784e1a-3ec4-4743-b660-8e9cbdd05f3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b', 'volume_size': 1}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-45864da5-94d5-4a81-ac23-369a428abf34-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-45864da5-94d5-4a81-ac23-369a428abf34-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-quobyte-45864da5-94d5-4a81-ac23-369a428abf34" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-45864da5-94d5-4a81-ac23-369a428abf34" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0464be1-d64d-4001-88bf-9e6b03c450a1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:55 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 1G" returned: 0 in 0.747s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:55 devstack sudo[94685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244
Sep 11 23:05:55 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:55 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34
Sep 11 23:05:55 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:55 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244" returned: 0 in 0.365s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:55 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 is being set with open permissions: ugo+rw
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:55 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244
Sep 11 23:05:55 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:55 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34" returned: 0 in 0.586s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:55 devstack sudo[94699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34
Sep 11 23:05:55 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:55 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317094914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26784e1a-3ec4-4743-b660-8e9cbdd05f3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a01b3fc70f41bd984ed5e5344397a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:05:54Z,use_quota=True,user_id='805f67d1c92c4577965832c410979060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Creating volume 26784e1a-3ec4-4743-b660-8e9cbdd05f3b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:05:55 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c2a3c90c-6033-4d3e-b5e8-4508244f13cf tempest-SnapshotsActionsTest-1728848519 None] Create snapshot completed successfully
Sep 11 23:05:55 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b 1073741824
Sep 11 23:05:55 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:55 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45864da5-94d5-4a81-ac23-369a428abf34" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-45864da5-94d5-4a81-ac23-369a428abf34" released by "delete_volume" :: held 0.997s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Created reservations ['f243ac5b-db98-442b-913e-2c42bb0e817b', 'd338dfd0-a9a1-4e63-a2ee-2cd465ab2f80', '27510836-9fca-464c-998b-14f5b225120a', '2ab6cb74-7315-48c2-b293-35c664db8d46'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:56 devstack sudo[94705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:56 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:56 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.292s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Deleted volume successfully.
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c54f21f3-e7ab-42f6-8dca-9783d18e5864 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-45864da5-94d5-4a81-ac23-369a428abf34-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:56 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b 1073741824" returned: 0 in 0.653s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:56 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b
Sep 11 23:05:56 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:56 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" returned: 0 in 0.342s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517c3027-55d4-4277-84a4-49db111542bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d4029-c19f-4d0c-80d8-fe6270d1241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:05:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-cf7bac70-9533-415f-a508-20322c032244-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b (26784e1a-3ec4-4743-b660-8e9cbdd05f3b): created successfully
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575d4029-c19f-4d0c-80d8-fe6270d1241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Flow 'volume_create_manager' (9081c723-5074-4fa8-baeb-5626bbaaea64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-cf7bac70-9533-415f-a508-20322c032244-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6e47ee7b-355a-40da-9ae5-fcaaa3e11534 tempest-VolumeQuotasAdminTestJSON-706459943 None] Created volume successfully.
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-cf7bac70-9533-415f-a508-20322c032244" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-cf7bac70-9533-415f-a508-20322c032244" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Deleting offline snapshot cf7bac70-9533-415f-a508-20322c032244 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] snapshot_file for this snap is: volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0b1c5e-156a-43ae-8144-0aea14f4f054]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:57 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244
Sep 11 23:05:57 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-c74bee8e-fbf6-4d75-ba9c-e40f645f245a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-c74bee8e-fbf6-4d75-ba9c-e40f645f245a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "cinder-quobyte-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7bb247-af18-4535-856d-4d088ffb906f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:57 devstack sudo[94717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a
Sep 11 23:05:57 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:57 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244" returned: 0 in 0.543s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "cinder-26784e1a-3ec4-4743-b660-8e9cbdd05f3b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be38ad-3b8f-45e9-b21a-9c505069bc1a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "cinder-26784e1a-3ec4-4743-b660-8e9cbdd05f3b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "cinder-quobyte-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "cinder-quobyte-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa8035-97b9-4d2c-8ca9-eb0d91dcb3c5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:05:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:57 devstack sudo[94722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:05:57 devstack sudo[94722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b
Sep 11 23:05:58 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:58 devstack sudo[94731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a
Sep 11 23:05:58 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94722]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.415s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:58 devstack sudo[94737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244
Sep 11 23:05:58 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" returned: 0 in 0.438s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:58 devstack sudo[94743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b
Sep 11 23:05:58 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-quobyte-c74bee8e-fbf6-4d75-ba9c-e40f645f245a" released by "delete_volume" :: held 0.878s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Created reservations ['da24cf6f-fbf8-473f-a292-0fec3257c293', '65bdf9bb-56c2-48d2-b22b-31f56938db38', 'e7552b8f-667c-47d1-a681-d011bdf305c8', '34114f65-93bf-4cfa-9c14-7cc6d5697d03'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:58 devstack sudo[94751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:58 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244" returned: 0 in 0.513s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:58 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244
Sep 11 23:05:58 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "cinder-quobyte-26784e1a-3ec4-4743-b660-8e9cbdd05f3b" released by "delete_volume" :: held 0.914s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Created reservations ['e57254ea-77a8-47be-aa74-1524502134e1', 'c3edad5d-ad5a-4406-8074-c343633f05c3', '7747b949-35ec-491f-a547-7de67ecf1e60', '27aabbb1-abac-4fc8-855b-8c28ca07b7ef'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:58 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Deleted volume successfully.
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf025a8f-d577-4521-89c7-ec29f46d8258 tempest-AttachVolumeTestJSON-1190945035 None] Lock "cinder-c74bee8e-fbf6-4d75-ba9c-e40f645f245a-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:05:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:05:59 devstack sudo[94758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:05:59 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:05:59 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.cf7bac70-9533-415f-a508-20322c032244" returned: 0 in 0.341s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-cf7bac70-9533-415f-a508-20322c032244" released by "_delete_snapshot" :: held 1.999s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_snapshot" :: held 2.056s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Created reservations ['36a5e647-9520-4c7a-8acb-1dba67143096', '47a158c7-b7da-447b-a491-4dedfd833ab2', '406844e6-50f9-4029-8f10-12652475f3f0', 'b5012e5b-b8fd-43de-bcb5-53fc0fd68dc6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:05:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Delete snapshot completed successfully.
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe808661-e39f-4c86-a61d-f020260fc8aa tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-cf7bac70-9533-415f-a508-20322c032244-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:05:59 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.327s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:05:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Deleted volume successfully.
Sep 11 23:05:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb96755d-ec99-4b36-adca-aa6c9840a3a6 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "cinder-26784e1a-3ec4-4743-b660-8e9cbdd05f3b-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Flow 'volume_create_manager' (ae803143-b017-4ca6-9762-0a5d6165f9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f382a9e-1101-4e43-9221-c124c750a755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Creating offline snapshot 76e17ebe-71d0-4093-bbe5-1e6e5566a397 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f382a9e-1101-4e43-9221-c124c750a755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1348182281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c774e-d93c-4bdc-822c-06fbf89b7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a01b3fc70f41bd984ed5e5344397a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:01Z,use_quota=True,user_id='805f67d1c92c4577965832c410979060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a53f8e-c519-45d1-b519-21390e5d7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a53f8e-c519-45d1-b519-21390e5d7be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b687c2b-3f20-4d4e-862b-d3f1c90785c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b687c2b-3f20-4d4e-862b-d3f1c90785c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1c774e-d93c-4bdc-822c-06fbf89b7a22', 'volume_name': 'volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a1d7e-798c-4af3-a5d1-456ebef3196b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (834a1d7e-798c-4af3-a5d1-456ebef3196b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af3061-60b3-4c19-bc35-47eb826b3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume 8d1c774e-d93c-4bdc-822c-06fbf89b7a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22', 'volume_size': 1}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9fbe1b-76ee-4b62-ab54-9550a6d46be4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:01 devstack sudo[94765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:01 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:01 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.446s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:01 devstack sudo[94771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 1G
Sep 11 23:06:01 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:02 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 1G" returned: 0 in 0.623s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:02 devstack sudo[94792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397
Sep 11 23:06:02 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:02 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397" returned: 0 in 0.362s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:02 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 is being set with open permissions: ugo+rw
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:02 devstack sudo[94801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397
Sep 11 23:06:02 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:02 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.910s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.766s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1348182281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c774e-d93c-4bdc-822c-06fbf89b7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a01b3fc70f41bd984ed5e5344397a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:01Z,use_quota=True,user_id='805f67d1c92c4577965832c410979060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Creating volume 8d1c774e-d93c-4bdc-822c-06fbf89b7a22 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:02 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:02 devstack sudo[94831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 1073741824
Sep 11 23:06:02 devstack sudo[94831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-46c95234-2560-44c8-b8f2-b9879f43a763 tempest-SnapshotsActionsTest-1728848519 None] Create snapshot completed successfully
Sep 11 23:06:03 devstack sudo[94831]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 1073741824" returned: 0 in 0.485s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:03 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22
Sep 11 23:06:03 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:03 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" returned: 0 in 0.358s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af3061-60b3-4c19-bc35-47eb826b3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9935dc98-3778-4937-b3ae-026a5ead3ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:03 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Volume volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 (8d1c774e-d93c-4bdc-822c-06fbf89b7a22): created successfully
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9935dc98-3778-4937-b3ae-026a5ead3ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Flow 'volume_create_manager' (ae803143-b017-4ca6-9762-0a5d6165f9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b23252a3-2e01-4f78-b789-2fd20b50f1f3 tempest-VolumeQuotasAdminTestJSON-706459943 None] Created volume successfully.
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-76e17ebe-71d0-4093-bbe5-1e6e5566a397-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-76e17ebe-71d0-4093-bbe5-1e6e5566a397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-76e17ebe-71d0-4093-bbe5-1e6e5566a397" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-76e17ebe-71d0-4093-bbe5-1e6e5566a397" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Deleting offline snapshot 76e17ebe-71d0-4093-bbe5-1e6e5566a397 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] snapshot_file for this snap is: volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c24f202-f95f-4c43-bc3d-35e8a6e02e9e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:04 devstack sudo[94850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397
Sep 11 23:06:04 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:04 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397" returned: 0 in 0.636s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28eece-0ac1-49b3-a797-55f65784374d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:05 devstack sudo[94869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:05 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:05 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=118,cinder:INSERT=35,cinder:UPDATE=145,cinder:DELETE=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:06:05 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-27d10c23-a577-4d91-a69a-160f0b4bb490 tempest-VolumeQuotasAdminTestJSON-396224335 None] Transfer volume completed successfully.
Sep 11 23:06:05 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.914s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:05 devstack sudo[94925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397
Sep 11 23:06:05 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Acquiring lock "cinder-8d1c774e-d93c-4bdc-822c-06fbf89b7a22-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "cinder-8d1c774e-d93c-4bdc-822c-06fbf89b7a22-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Acquiring lock "cinder-quobyte-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "cinder-quobyte-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87b18a4-2d64-4a3d-a8b4-5567c3198435]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:06 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22
Sep 11 23:06:06 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:06 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397" returned: 0 in 0.829s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:06 devstack sudo[94938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397
Sep 11 23:06:06 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:07 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.76e17ebe-71d0-4093-bbe5-1e6e5566a397" returned: 0 in 0.523s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:07 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-76e17ebe-71d0-4093-bbe5-1e6e5566a397" released by "_delete_snapshot" :: held 3.156s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" returned: 0 in 0.775s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_snapshot" :: held 3.214s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=145,cinder:UPDATE=122,cinder:INSERT=28,cinder:DELETE=8 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:06:07 devstack sudo[94944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22
Sep 11 23:06:07 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Created reservations ['8891e6ce-b1cf-4f61-a30b-33d7116564ff', '7f99d9fd-409b-48ea-8cdc-7180482e7458', '84d9d120-17c9-4efa-8455-083577892f7e', '1aa3ef24-7e79-45d0-951c-ffcd9a36847f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Delete snapshot completed successfully.
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ddbb6ed-41ed-4279-b5e3-d31df4a8bf05 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-76e17ebe-71d0-4093-bbe5-1e6e5566a397-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:07 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" returned: 0 in 0.354s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "cinder-quobyte-8d1c774e-d93c-4bdc-822c-06fbf89b7a22" released by "delete_volume" :: held 1.190s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Created reservations ['a5d45b53-921e-4166-939b-dc68a47a3284', '5d06f4cd-b2a2-421a-aae3-93e488335fe6', '28496e7c-3e11-4276-9ba5-1111191006f9', 'dced4892-cd10-4bb6-bf3c-6fd25a66c150'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:07 devstack sudo[94947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:07 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:07 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.256s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:07 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Deleted volume successfully.
Sep 11 23:06:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ae91d0d0-4270-4bff-aec6-4dd97b860983 tempest-VolumeQuotasAdminTestJSON-1747584141 None] Lock "cinder-8d1c774e-d93c-4bdc-822c-06fbf89b7a22-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Creating offline snapshot 73bd9b44-783a-4631-95c1-0460d47906eb of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[219954c8-206c-412b-89e3-d118f8d79cf6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:09 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:09 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:09 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.612s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:09 devstack sudo[94956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb 1G
Sep 11 23:06:09 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:10 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb 1G" returned: 0 in 0.850s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:10 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb
Sep 11 23:06:10 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:10 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb" returned: 0 in 0.447s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:11 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb is being set with open permissions: ugo+rw
Sep 11 23:06:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:11 devstack sudo[94970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb
Sep 11 23:06:11 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:11 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb" returned: 0 in 0.427s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0ae7595e-bec3-4c47-b6e7-f3bd5fc044e1 tempest-SnapshotsActionsTest-1728848519 None] Create snapshot completed successfully
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-73bd9b44-783a-4631-95c1-0460d47906eb-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-73bd9b44-783a-4631-95c1-0460d47906eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Acquiring lock "cinder-quobyte-73bd9b44-783a-4631-95c1-0460d47906eb" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-73bd9b44-783a-4631-95c1-0460d47906eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Deleting offline snapshot 73bd9b44-783a-4631-95c1-0460d47906eb of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] snapshot_file for this snap is: volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8babbda-71e9-4fd2-af5f-41f1570d2336]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:12 devstack sudo[94979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb
Sep 11 23:06:12 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:13 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb" returned: 0 in 0.494s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a9b120-9ed0-4611-82d1-ff75cdb578aa]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:13 devstack sudo[94996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:13 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:13 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.542s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:13 devstack sudo[95004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb
Sep 11 23:06:13 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:14 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:14 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb
Sep 11 23:06:14 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:14 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.73bd9b44-783a-4631-95c1-0460d47906eb" returned: 0 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-73bd9b44-783a-4631-95c1-0460d47906eb" released by "_delete_snapshot" :: held 2.022s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_snapshot" :: held 2.069s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Created reservations ['0b21b5da-6f36-4838-baf9-de85792ed250', '4d0d475f-5a2a-4507-a6aa-36042cf3e272', 'f6d39ac4-6002-47ff-b626-f7f2c996a77b', '77f321f7-6d8b-484c-8b10-4c88453310b6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Delete snapshot completed successfully.
Sep 11 23:06:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5e5a3b4-5b53-48a1-8c0e-51e484ceede9 tempest-SnapshotsActionsTest-1724461499 None] Lock "cinder-73bd9b44-783a-4631-95c1-0460d47906eb-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "cinder-91403486-2de3-4ee1-9508-cbef3c35dc67-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-91403486-2de3-4ee1-9508-cbef3c35dc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "cinder-quobyte-91403486-2de3-4ee1-9508-cbef3c35dc67" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-91403486-2de3-4ee1-9508-cbef3c35dc67" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Deleting offline snapshot 91403486-2de3-4ee1-9508-cbef3c35dc67 of volume 5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] snapshot_file for this snap is: volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f016e0-a08a-4179-9572-f7e6163e7ac3]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:16 devstack sudo[95015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:16 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:17 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.509s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b37035a-b963-457d-9a78-750ab02258f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754dc7e-5ad8-443b-ae39-12885a48bdff]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:17 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3
Sep 11 23:06:17 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:17 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3" returned: 0 in 0.702s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:17 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:17 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:18 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.550s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:18 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67
Sep 11 23:06:18 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:18 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3.91403486-2de3-4ee1-9508-cbef3c35dc67" returned: 0 in 0.358s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-91403486-2de3-4ee1-9508-cbef3c35dc67" released by "_delete_snapshot" :: held 2.348s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_snapshot" :: held 2.408s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Created reservations ['ff3dc309-9f7b-4e3d-822f-4743ce6d8733', '9ab35036-252a-4c67-b4b1-ba6ed45dd627', '89c1336d-c652-4dd7-8670-7c4f841864a6', 'cf7534bf-3dc1-46d8-bb49-736f9457792e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Delete snapshot completed successfully.
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f083c23-7fd9-417d-ae89-ae1eb4a48266 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-91403486-2de3-4ee1-9508-cbef3c35dc67-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "cinder-5b37035a-b963-457d-9a78-750ab02258f3-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-5b37035a-b963-457d-9a78-750ab02258f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[576fe106-6ba8-446f-ac2d-696cd1571ba7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:20 devstack sudo[95057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3
Sep 11 23:06:20 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:20 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3" returned: 0 in 0.462s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:20 devstack sudo[95062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3
Sep 11 23:06:20 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:20 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b37035a-b963-457d-9a78-750ab02258f3" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-quobyte-5b37035a-b963-457d-9a78-750ab02258f3" released by "delete_volume" :: held 0.950s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:20 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Created reservations ['b7b969d6-d8fb-4de9-8002-3683aab1186b', 'c517f135-572e-4ba2-b8b8-997ab3d2018e', '95d4f06a-68df-4834-8500-7003a05e2c73', '0cd5c384-d4f9-40c2-b839-d12e832becc2'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:21 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:21 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:21 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.444s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Deleted volume successfully.
Sep 11 23:06:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-422fc717-543c-4992-a0a9-898d1e502990 tempest-SnapshotsActionsTest-1728848519 None] Lock "cinder-5b37035a-b963-457d-9a78-750ab02258f3-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Flow 'volume_create_manager' (30c621c7-8759-4f5c-b2d8-c4f349e836ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908d6c0-a529-43d7-a89f-ae80d132405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1908d6c0-a529-43d7-a89f-ae80d132405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-352930028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e359284-8db6-4a8c-a8d5-f2816c97c180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d35b00cd54f409c8b85be03cb8dac2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:26Z,use_quota=True,user_id='3e1f3412e76744a7962e63043226c773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f281eba4-e48b-4ac1-9bd7-888ac938f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f281eba4-e48b-4ac1-9bd7-888ac938f017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a69e817-202f-425b-b0b2-c4c74b0e0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a69e817-202f-425b-b0b2-c4c74b0e0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e359284-8db6-4a8c-a8d5-f2816c97c180', 'volume_name': 'volume-2e359284-8db6-4a8c-a8d5-f2816c97c180', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af49fb1b-6791-483d-bee8-882b9a5850df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af49fb1b-6791-483d-bee8-882b9a5850df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af61ad4e-42eb-42fb-a0ef-d70a3631fca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Volume 2e359284-8db6-4a8c-a8d5-f2816c97c180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e359284-8db6-4a8c-a8d5-f2816c97c180', 'volume_size': 1}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-352930028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e359284-8db6-4a8c-a8d5-f2816c97c180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d35b00cd54f409c8b85be03cb8dac2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:26Z,use_quota=True,user_id='3e1f3412e76744a7962e63043226c773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Creating volume 2e359284-8db6-4a8c-a8d5-f2816c97c180 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:26 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:26 devstack sudo[95118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 1073741824
Sep 11 23:06:26 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:27 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 1073741824" returned: 0 in 0.897s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:27 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180
Sep 11 23:06:27 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:27 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180" returned: 0 in 0.357s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af61ad4e-42eb-42fb-a0ef-d70a3631fca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e359284-8db6-4a8c-a8d5-f2816c97c180', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab1577d-878e-4d30-9fb9-7c12f0713ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Volume volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 (2e359284-8db6-4a8c-a8d5-f2816c97c180): created successfully
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab1577d-878e-4d30-9fb9-7c12f0713ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Flow 'volume_create_manager' (30c621c7-8759-4f5c-b2d8-c4f349e836ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e572b46e-49ed-44d8-8ac6-6045c9bc9a5e tempest-VolumeQuotasNegativeTestJSON-61601025 None] Created volume successfully.
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Acquiring lock "cinder-2e359284-8db6-4a8c-a8d5-f2816c97c180-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "cinder-2e359284-8db6-4a8c-a8d5-f2816c97c180-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Acquiring lock "cinder-quobyte-2e359284-8db6-4a8c-a8d5-f2816c97c180" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "cinder-quobyte-2e359284-8db6-4a8c-a8d5-f2816c97c180" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe583f6-96e1-4b5d-aa9a-51fe78791c03]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:30 devstack sudo[95154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180
Sep 11 23:06:30 devstack sudo[95154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:31 devstack sudo[95154]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180" returned: 0 in 0.575s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:31 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180
Sep 11 23:06:31 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:31 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2e359284-8db6-4a8c-a8d5-f2816c97c180" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "cinder-quobyte-2e359284-8db6-4a8c-a8d5-f2816c97c180" released by "delete_volume" :: held 0.964s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Created reservations ['88b4ff9b-d6e3-459c-bec7-47d0c247c41c', '26510362-ffd7-41c8-9d23-3ad155b31064', '8b24b25c-0df9-485a-883e-37f5b3aba7b5', '922e0930-75ed-4533-89d5-c032a4143e4e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:31 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:31 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:31 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Deleted volume successfully.
Sep 11 23:06:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7de0548-33f0-44d8-870a-03aa088cdf79 tempest-VolumeQuotasNegativeTestJSON-61601025 None] Lock "cinder-2e359284-8db6-4a8c-a8d5-f2816c97c180-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Flow 'volume_create_manager' (9a076a1e-d827-467f-b182-4e27bbf55dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbec2b-3900-4c97-b37e-346ef5c26022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbdbec2b-3900-4c97-b37e-346ef5c26022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-935884558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe04150-6d66-475e-93ae-163c8ebb930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a21ba139bc04272b0d98c3e857cb78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:33Z,use_quota=True,user_id='54bef06cd3a247ae865c619db2dd0423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0e8132-749a-4c26-8a7a-c89c215c7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d0e8132-749a-4c26-8a7a-c89c215c7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8856d4-39cc-4a37-9e37-6e920284d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8856d4-39cc-4a37-9e37-6e920284d34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbe04150-6d66-475e-93ae-163c8ebb930d', 'volume_name': 'volume-bbe04150-6d66-475e-93ae-163c8ebb930d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d992c3e-4f7a-4f21-91d7-70c75de84864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d992c3e-4f7a-4f21-91d7-70c75de84864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ecd13-2018-4f92-b686-23d0626eb0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Volume bbe04150-6d66-475e-93ae-163c8ebb930d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbe04150-6d66-475e-93ae-163c8ebb930d', 'volume_size': 1}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-935884558',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbe04150-6d66-475e-93ae-163c8ebb930d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a21ba139bc04272b0d98c3e857cb78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:33Z,use_quota=True,user_id='54bef06cd3a247ae865c619db2dd0423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Creating volume bbe04150-6d66-475e-93ae-163c8ebb930d {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:33 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:33 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d 1073741824
Sep 11 23:06:33 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:34 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d 1073741824" returned: 0 in 0.614s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:34 devstack sudo[95194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d
Sep 11 23:06:34 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:34 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (409ecd13-2018-4f92-b686-23d0626eb0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbe04150-6d66-475e-93ae-163c8ebb930d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5470ff-c012-4ccc-af35-7a645b8efabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:34 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Volume volume-bbe04150-6d66-475e-93ae-163c8ebb930d (bbe04150-6d66-475e-93ae-163c8ebb930d): created successfully
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5470ff-c012-4ccc-af35-7a645b8efabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Flow 'volume_create_manager' (9a076a1e-d827-467f-b182-4e27bbf55dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-73e4c370-dc01-4764-89d7-eb7d272e6e69 tempest-ServersNegativeTestJSON-32373063 None] Created volume successfully.
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Flow 'volume_create_manager' (6dced95e-4d4e-41b1-80b7-022e1e34627a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e35b2c6-c343-4de7-9319-0b59a4103f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e35b2c6-c343-4de7-9319-0b59a4103f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-322876580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a1f5f0-766c-4ade-bc04-75926bd1e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a21ba139bc04272b0d98c3e857cb78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:38Z,use_quota=True,user_id='54bef06cd3a247ae865c619db2dd0423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b54b36c-2e4f-44f7-8e26-ad253a7de92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b54b36c-2e4f-44f7-8e26-ad253a7de92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79db122b-19d9-47b6-bfd4-015e11f53b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79db122b-19d9-47b6-bfd4-015e11f53b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7a1f5f0-766c-4ade-bc04-75926bd1e476', 'volume_name': 'volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b34054-cf27-4171-a30b-28effb4d6e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b34054-cf27-4171-a30b-28effb4d6e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1916321-ea3a-4a95-b17b-924da9dce3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Volume b7a1f5f0-766c-4ade-bc04-75926bd1e476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476', 'volume_size': 1}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-322876580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a1f5f0-766c-4ade-bc04-75926bd1e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a21ba139bc04272b0d98c3e857cb78d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:38Z,use_quota=True,user_id='54bef06cd3a247ae865c619db2dd0423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Creating volume b7a1f5f0-766c-4ade-bc04-75926bd1e476 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:38 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:38 devstack sudo[95266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 1073741824
Sep 11 23:06:38 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:39 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 1073741824" returned: 0 in 0.825s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:39 devstack sudo[95273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476
Sep 11 23:06:39 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:39 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476" returned: 0 in 0.396s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1916321-ea3a-4a95-b17b-924da9dce3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab20a9-14d5-4276-bb54-067843244a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Volume volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 (b7a1f5f0-766c-4ade-bc04-75926bd1e476): created successfully
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fab20a9-14d5-4276-bb54-067843244a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Flow 'volume_create_manager' (6dced95e-4d4e-41b1-80b7-022e1e34627a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0e1b8fc4-ece4-49e5-8453-8b54ef3a95e1 tempest-ServersNegativeTestJSON-32373063 None] Created volume successfully.
Sep 11 23:06:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "cinder-b7a1f5f0-766c-4ade-bc04-75926bd1e476-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-b7a1f5f0-766c-4ade-bc04-75926bd1e476-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "cinder-quobyte-b7a1f5f0-766c-4ade-bc04-75926bd1e476" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-quobyte-b7a1f5f0-766c-4ade-bc04-75926bd1e476" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ee060b-e15e-4f7c-8df5-a8a547397faa]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:41 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476
Sep 11 23:06:41 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:41 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476" returned: 0 in 0.620s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:41 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476
Sep 11 23:06:41 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:42 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b7a1f5f0-766c-4ade-bc04-75926bd1e476" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-quobyte-b7a1f5f0-766c-4ade-bc04-75926bd1e476" released by "delete_volume" :: held 1.113s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Created reservations ['a30b745a-c0dc-485d-aa1f-32d607f41d57', '6ca546e3-0982-4519-bc6d-dec2f0c87154', '0e6f1c39-f797-4f4a-ae2d-52acc249e876', '73eab079-804f-48f3-9e4c-a6cbf8fdbcaf'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:42 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:42 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:42 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.367s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Deleted volume successfully.
Sep 11 23:06:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e0f46fcd-fbca-4fa8-a41c-930f4074d5a2 tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-b7a1f5f0-766c-4ade-bc04-75926bd1e476-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "cinder-bbe04150-6d66-475e-93ae-163c8ebb930d-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-bbe04150-6d66-475e-93ae-163c8ebb930d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "cinder-quobyte-bbe04150-6d66-475e-93ae-163c8ebb930d" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-quobyte-bbe04150-6d66-475e-93ae-163c8ebb930d" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ec315-d563-405b-8378-1e8c2a2485b9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:43 devstack sudo[95291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d
Sep 11 23:06:43 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:43 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d" returned: 0 in 0.524s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:44 devstack sudo[95296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d
Sep 11 23:06:44 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:44 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bbe04150-6d66-475e-93ae-163c8ebb930d" returned: 0 in 0.300s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-quobyte-bbe04150-6d66-475e-93ae-163c8ebb930d" released by "delete_volume" :: held 0.897s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Created reservations ['10263098-4b90-4b13-9721-ed4578fb05e8', 'b35d23f1-6f88-4e46-b740-8d76f934c2e0', 'e891d4c6-e9f8-4d67-9360-744ab2fd60ac', '432022cc-6954-423c-9ed5-519639a1cb8e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:44 devstack sudo[95299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:44 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:44 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Deleted volume successfully.
Sep 11 23:06:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-55dee9dc-7101-4f33-ad08-6154d9d0cccd tempest-ServersNegativeTestJSON-32373063 None] Lock "cinder-bbe04150-6d66-475e-93ae-163c8ebb930d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:46 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:46 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:46 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.519s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:06:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Flow 'volume_create_manager' (6797a173-edc3-4020-a0d8-73c4e0646a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da296929-e278-4fcb-acc5-80511015e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da296929-e278-4fcb-acc5-80511015e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1539041147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b21385f-19a1-4e98-b938-6cd853f0031a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff971750f0c54f31a3617768c9809de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:47Z,use_quota=True,user_id='922e4254e3f4422db44b89179db56db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a05782-cbc8-4496-b7e2-e32b8fc6f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a05782-cbc8-4496-b7e2-e32b8fc6f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6252fc10-4c3d-4ce5-ba6f-92768db8bb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6252fc10-4c3d-4ce5-ba6f-92768db8bb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b21385f-19a1-4e98-b938-6cd853f0031a', 'volume_name': 'volume-7b21385f-19a1-4e98-b938-6cd853f0031a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fe8da-0284-4bad-9b6f-48e0ce59cfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fe8da-0284-4bad-9b6f-48e0ce59cfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3268f501-cf24-4a87-919c-ff7a3fa0bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:47 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Volume 7b21385f-19a1-4e98-b938-6cd853f0031a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b21385f-19a1-4e98-b938-6cd853f0031a', 'volume_size': 1}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1539041147',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b21385f-19a1-4e98-b938-6cd853f0031a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff971750f0c54f31a3617768c9809de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:47Z,use_quota=True,user_id='922e4254e3f4422db44b89179db56db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Creating volume 7b21385f-19a1-4e98-b938-6cd853f0031a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:47 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:47 devstack sudo[95330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a 1073741824
Sep 11 23:06:47 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:48 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a 1073741824" returned: 0 in 0.717s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:48 devstack sudo[95336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a
Sep 11 23:06:48 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:48 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a" returned: 0 in 0.365s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3268f501-cf24-4a87-919c-ff7a3fa0bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b21385f-19a1-4e98-b938-6cd853f0031a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fba664-03ed-4d6b-8a06-03077ed10811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:48 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Volume volume-7b21385f-19a1-4e98-b938-6cd853f0031a (7b21385f-19a1-4e98-b938-6cd853f0031a): created successfully
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fba664-03ed-4d6b-8a06-03077ed10811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Flow 'volume_create_manager' (6797a173-edc3-4020-a0d8-73c4e0646a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-25950019-4422-483d-81e6-06a1b8b7fa76 tempest-VolumesServicesTestJSON-2086648991 None] Created volume successfully.
Sep 11 23:06:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Acquiring lock "cinder-7b21385f-19a1-4e98-b938-6cd853f0031a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "cinder-7b21385f-19a1-4e98-b938-6cd853f0031a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Acquiring lock "cinder-quobyte-7b21385f-19a1-4e98-b938-6cd853f0031a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:06:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "cinder-quobyte-7b21385f-19a1-4e98-b938-6cd853f0031a" acquired by "delete_volume" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:06:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d79f6d-a320-4a45-9423-772d2d3ed779]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:06:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:50 devstack sudo[95340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a
Sep 11 23:06:50 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:50 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a" returned: 0 in 0.576s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:50 devstack sudo[95354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a
Sep 11 23:06:50 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:51 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b21385f-19a1-4e98-b938-6cd853f0031a" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "cinder-quobyte-7b21385f-19a1-4e98-b938-6cd853f0031a" released by "delete_volume" :: held 1.117s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Created reservations ['685ca7bb-ae23-441f-a1df-19408c2c3e16', '1fce3760-4842-47ce-b9b4-745bbd8a7d7e', '423b7470-97de-40c7-b566-b83dc304f4ca', '85bdbc1c-6404-4a6d-89c3-26e44b67d60e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:51 devstack sudo[95372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:06:51 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:51 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.300s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:06:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Deleted volume successfully.
Sep 11 23:06:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b8a84afe-836d-4282-992b-2eb55b2aa56e tempest-VolumesServicesTestJSON-2086648991 None] Lock "cinder-7b21385f-19a1-4e98-b938-6cd853f0031a-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Flow 'volume_create_manager' (f3c06559-a484-4747-befa-a7b81b996d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3741250c-43b5-4d90-aa9e-4386f86c41e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3741250c-43b5-4d90-aa9e-4386f86c41e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-843388933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a1fe98-4619-4f23-806b-f7280db6f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cfb71051047ad9c5dcc3cb58dc113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='228b6135093d482bbec481d89fef1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d10f39-2898-4b68-9f17-238862f9dd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d10f39-2898-4b68-9f17-238862f9dd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c416ad-701d-4d7e-bffb-19641bf3c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c416ad-701d-4d7e-bffb-19641bf3c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43a1fe98-4619-4f23-806b-f7280db6f374', 'volume_name': 'volume-43a1fe98-4619-4f23-806b-f7280db6f374', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb6d051-fff9-41d1-a00c-efafda3a3c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb6d051-fff9-41d1-a00c-efafda3a3c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd366377-15c8-426f-9ebc-502be6747a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:58 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Volume 43a1fe98-4619-4f23-806b-f7280db6f374: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43a1fe98-4619-4f23-806b-f7280db6f374', 'volume_size': 1}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:06:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-843388933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a1fe98-4619-4f23-806b-f7280db6f374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cfb71051047ad9c5dcc3cb58dc113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:06:59Z,use_quota=True,user_id='228b6135093d482bbec481d89fef1136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Creating volume 43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:06:58 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:06:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:58 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 1073741824
Sep 11 23:06:58 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:59 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 1073741824" returned: 0 in 0.580s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:06:59 devstack sudo[95383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374
Sep 11 23:06:59 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:06:59 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd366377-15c8-426f-9ebc-502be6747a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a1fe98-4619-4f23-806b-f7280db6f374', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eba545-868e-4347-a6ff-b67451934bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:06:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Volume volume-43a1fe98-4619-4f23-806b-f7280db6f374 (43a1fe98-4619-4f23-806b-f7280db6f374): created successfully
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49eba545-868e-4347-a6ff-b67451934bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:06:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Flow 'volume_create_manager' (f3c06559-a484-4747-befa-a7b81b996d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:06:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-36fa9cb5-5943-44f8-bce9-8832024c80bf req-23d7f5a5-fa72-431b-8564-bb917418c625 tempest-VolumesSnapshotsTestJSON-1352651202 None] Created volume successfully.
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Flow 'volume_create_manager' (fc1608bf-49d0-476e-9976-cf36cf3e2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b37c40-e0c6-4038-99be-3876f4ca6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b37c40-e0c6-4038-99be-3876f4ca6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-973542688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4763459-4237-4d7d-be7b-637c848e7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da18d5bd59984ed5a832554b314d52d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='4cb9356d7fa9450baf4563dd4c246f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df93ba5-99a2-4ae9-86d8-0c2f8afb2b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df93ba5-99a2-4ae9-86d8-0c2f8afb2b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d103f04-fba1-4e4a-b708-6b89b566e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d103f04-fba1-4e4a-b708-6b89b566e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4763459-4237-4d7d-be7b-637c848e7e96', 'volume_name': 'volume-c4763459-4237-4d7d-be7b-637c848e7e96', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bfa1d3-2a3d-4f25-b45d-4f10eb323b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4bfa1d3-2a3d-4f25-b45d-4f10eb323b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af013a60-885f-46b5-9d38-2a11773c469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Volume c4763459-4237-4d7d-be7b-637c848e7e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4763459-4237-4d7d-be7b-637c848e7e96', 'volume_size': 1}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-973542688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4763459-4237-4d7d-be7b-637c848e7e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da18d5bd59984ed5a832554b314d52d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:01Z,use_quota=True,user_id='4cb9356d7fa9450baf4563dd4c246f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Creating volume c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:01 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:01 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 1073741824
Sep 11 23:07:01 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:01 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 1073741824" returned: 0 in 0.499s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:01 devstack sudo[95392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96
Sep 11 23:07:01 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:01 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96" returned: 0 in 0.271s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.702s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af013a60-885f-46b5-9d38-2a11773c469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4763459-4237-4d7d-be7b-637c848e7e96', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da9a904-80ac-4177-9ca4-6c3811b0f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Creating offline snapshot dd3dbde3-9713-4200-a085-5c5cfc197e14 of volume 43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:07:02 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Volume volume-c4763459-4237-4d7d-be7b-637c848e7e96 (c4763459-4237-4d7d-be7b-637c848e7e96): created successfully
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da9a904-80ac-4177-9ca4-6c3811b0f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Flow 'volume_create_manager' (fc1608bf-49d0-476e-9976-cf36cf3e2713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[258b6fce-9c81-4b56-8c9b-e70cfcdcb03e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc00e158-40cb-4b7d-9a95-ac7446150d7f tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Created volume successfully.
Sep 11 23:07:02 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374
Sep 11 23:07:02 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:02 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:02 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 1G
Sep 11 23:07:02 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:02 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 1G" returned: 0 in 0.493s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fe98-4619-4f23-806b-f7280db6f374 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:02 devstack sudo[95408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fe98-4619-4f23-806b-f7280db6f374 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14
Sep 11 23:07:02 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:03 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43a1fe98-4619-4f23-806b-f7280db6f374 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14" returned: 0 in 0.453s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:03 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 is being set with open permissions: ugo+rw
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:03 devstack sudo[95448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14
Sep 11 23:07:03 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (503e4bb3-67fe-4f86-89f3-aa51082a222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922a410-8cdf-46fe-b0b5-a589dee6e8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5922a410-8cdf-46fe-b0b5-a589dee6e8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751490880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:04Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d87b13-e5d5-4af4-a16a-636d171806af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d87b13-e5d5-4af4-a16a-636d171806af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2802ea2-1a7e-4278-9990-eae53984c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2802ea2-1a7e-4278-9990-eae53984c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3', 'volume_name': 'volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:03 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad56672-fd64-4879-9352-744e0355a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad56672-fd64-4879-9352-744e0355a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fabd8f-9914-4c1d-aaee-ff4411c320ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:03 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Volume 6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3', 'volume_size': 1}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14" returned: 0 in 0.392s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:03 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info
Sep 11 23:07:03 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:04 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:04 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info is being set with open permissions: ugo+rw
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:04 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info
Sep 11 23:07:04 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:04 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.info" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.412s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.042s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Creating offline snapshot 61f09b09-fcde-40e7-8c93-ad67e0004f5d of volume c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:07:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-ddbdef4f-9f2d-429f-b936-c7d2fb779054 req-723f5ad2-7a87-4d20-b85e-6b8f44585bb7 tempest-VolumesSnapshotsTestJSON-1352651202 None] Create snapshot completed successfully
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a885c9-9216-451a-84b1-fd4773e3842d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:04 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96
Sep 11 23:07:04 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:04 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:04 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d 1G
Sep 11 23:07:04 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "cinder-dd3dbde3-9713-4200-a085-5c5cfc197e14-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-dd3dbde3-9713-4200-a085-5c5cfc197e14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "cinder-quobyte-dd3dbde3-9713-4200-a085-5c5cfc197e14" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-dd3dbde3-9713-4200-a085-5c5cfc197e14" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Deleting offline snapshot dd3dbde3-9713-4200-a085-5c5cfc197e14 of volume 43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] snapshot_file for this snap is: volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b954baca-6368-4c8a-8cf2-baaa5502c806]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:05 devstack sudo[95470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14
Sep 11 23:07:05 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:05 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d 1G" returned: 0 in 0.478s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4763459-4237-4d7d-be7b-637c848e7e96 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:05 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4763459-4237-4d7d-be7b-637c848e7e96 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d
Sep 11 23:07:05 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:05 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14" returned: 0 in 0.480s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43a1fe98-4619-4f23-806b-f7280db6f374(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9393e56-5f16-45e1-bcae-7c64ceae2f0b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:05 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4763459-4237-4d7d-be7b-637c848e7e96 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:05 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d is being set with open permissions: ugo+rw
Sep 11 23:07:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:05 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d
Sep 11 23:07:05 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:05 devstack sudo[95484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374
Sep 11 23:07:05 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=81,cinder:SELECT=58,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:06 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info
Sep 11 23:07:06 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374" returned: 0 in 0.434s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:06 devstack sudo[95495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14
Sep 11 23:07:06 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info is being set with open permissions: ugo+rw
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:06 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info
Sep 11 23:07:06 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14" returned: 0 in 0.457s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:06 devstack sudo[95503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14
Sep 11 23:07:06 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.info" returned: 0 in 0.298s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1751490880',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:04Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Creating volume 6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:06 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:06 devstack sudo[95506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 1073741824
Sep 11 23:07:06 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-00fafa14-d6d6-4fe4-b79c-a060757c91b0 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Create snapshot completed successfully
Sep 11 23:07:06 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374.dd3dbde3-9713-4200-a085-5c5cfc197e14" returned: 0 in 0.304s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-dd3dbde3-9713-4200-a085-5c5cfc197e14" released by "_delete_snapshot" :: held 1.806s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" released by "delete_snapshot" :: held 1.846s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.quota [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Created reservations ['6d200733-f717-41c8-807b-0969d82f7b61', '9ae8a326-116a-4dd1-be78-9a8d5b50379d', '53e67c8c-752e-477c-b199-416bf96d3d3b', 'a9ee06ae-ed9e-4425-915d-392bdb3de32e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Delete snapshot completed successfully.
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-a63671ff-edd9-4b54-871f-12514a469e70 req-a30f5650-6b44-4ee5-8ca1-43e0684fe8b2 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-dd3dbde3-9713-4200-a085-5c5cfc197e14-delete_snapshot" released by "delete_snapshot" :: held 2.013s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:07 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 1073741824" returned: 0 in 0.498s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:07 devstack sudo[95513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3
Sep 11 23:07:07 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "cinder-43a1fe98-4619-4f23-806b-f7280db6f374-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-43a1fe98-4619-4f23-806b-f7280db6f374-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=99,cinder:DELETE=7 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" acquired by "delete_volume" :: waited 0.051s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229baf7-0b0e-40c0-9cf3-5eb787865e40]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:07 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" returned: 0 in 0.365s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fabd8f-9914-4c1d-aaee-ff4411c320ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f50a60-5467-4bb0-adb4-b5802ac135b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:07 devstack sudo[95515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374
Sep 11 23:07:07 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Volume volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 (6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3): created successfully
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3f50a60-5467-4bb0-adb4-b5802ac135b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (503e4bb3-67fe-4f86-89f3-aa51082a222a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b67bfc5a-d3e1-4ca7-bd19-848a713ee52d tempest-AttachVolumeNegativeTest-2066173202 None] Created volume successfully.
Sep 11 23:07:08 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374" returned: 0 in 0.440s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:08 devstack sudo[95521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374
Sep 11 23:07:08 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "cinder-61f09b09-fcde-40e7-8c93-ad67e0004f5d-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-61f09b09-fcde-40e7-8c93-ad67e0004f5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "cinder-quobyte-61f09b09-fcde-40e7-8c93-ad67e0004f5d" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-61f09b09-fcde-40e7-8c93-ad67e0004f5d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Deleting offline snapshot 61f09b09-fcde-40e7-8c93-ad67e0004f5d of volume c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] snapshot_file for this snap is: volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538e6b4-ee8a-4aed-9d58-7a2f6ad3408d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:08 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-43a1fe98-4619-4f23-806b-f7280db6f374" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:08 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d
Sep 11 23:07:08 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-quobyte-43a1fe98-4619-4f23-806b-f7280db6f374" released by "delete_volume" :: held 0.819s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.quota [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Created reservations ['64863bbc-fb2b-4c61-826a-2d0773f67920', 'd41087b1-7b03-42c3-bff6-c4bbfc666942', '5faacab3-930a-47c4-b6da-ce20fad04283', '769e1a9c-5f06-4ae0-9409-434da0339ca8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:08 devstack sudo[95526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:08 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:08 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d" returned: 0 in 0.444s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4763459-4237-4d7d-be7b-637c848e7e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[135ceedf-c17b-4d52-92f2-925d56733696]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:08 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.manager [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Deleted volume successfully.
Sep 11 23:07:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-9c75db66-3dd1-42e8-8c2a-6b5cadec2872 req-f1d91e11-7c04-4223-a194-32ed8d482826 tempest-VolumesSnapshotsTestJSON-1352651202 None] Lock "cinder-43a1fe98-4619-4f23-806b-f7280db6f374-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:08 devstack sudo[95531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96
Sep 11 23:07:08 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:09 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96" returned: 0 in 0.596s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:09 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d
Sep 11 23:07:09 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:09 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d" returned: 0 in 0.500s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:09 devstack sudo[95549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d
Sep 11 23:07:09 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:10 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96.61f09b09-fcde-40e7-8c93-ad67e0004f5d" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-61f09b09-fcde-40e7-8c93-ad67e0004f5d" released by "_delete_snapshot" :: held 2.056s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" released by "delete_snapshot" :: held 2.083s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0b5bc397-73dd-4a74-8d63-ec5df2a9a978 req-b415af2e-d5c1-46f2-a7eb-0f825fd9c331 tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0b5bc397-73dd-4a74-8d63-ec5df2a9a978 req-b415af2e-d5c1-46f2-a7eb-0f825fd9c331 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-0b5bc397-73dd-4a74-8d63-ec5df2a9a978 req-b415af2e-d5c1-46f2-a7eb-0f825fd9c331 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-0b5bc397-73dd-4a74-8d63-ec5df2a9a978 req-b415af2e-d5c1-46f2-a7eb-0f825fd9c331 tempest-AttachVolumeNegativeTest-2066173202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '898fad1a-27a6-48f2-808d-8aabbbb598fe', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Created reservations ['bf39cded-b3e1-4b71-9278-0583b9b6fb53', '00e59d7d-bc61-486c-8835-a9fb62546c92', '17037d0d-23bd-4454-a566-72d764d96dba', 'cda6e955-3a9c-422c-a5dd-0efb6ce96d54'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-0b5bc397-73dd-4a74-8d63-ec5df2a9a978 req-b415af2e-d5c1-46f2-a7eb-0f825fd9c331 tempest-AttachVolumeNegativeTest-2066173202 None] attachment_update completed successfully.
Sep 11 23:07:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Delete snapshot completed successfully.
Sep 11 23:07:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-18d36394-5cf8-4d0a-8fae-5ed62bd53a24 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-61f09b09-fcde-40e7-8c93-ad67e0004f5d-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "cinder-c4763459-4237-4d7d-be7b-637c848e7e96-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-c4763459-4237-4d7d-be7b-637c848e7e96-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2972b532-f2ed-41a3-aa8b-8ec4baf08fcb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:11 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96
Sep 11 23:07:11 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:12 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96" returned: 0 in 0.427s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:12 devstack sudo[95948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96
Sep 11 23:07:12 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:12 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c4763459-4237-4d7d-be7b-637c848e7e96" returned: 0 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-quobyte-c4763459-4237-4d7d-be7b-637c848e7e96" released by "delete_volume" :: held 0.903s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Created reservations ['0b50cbe7-038c-4e98-b281-58bfe3491933', 'c40b8d54-b8b3-4b00-adb9-0b157dfa11ca', 'e05f3534-5e4d-4591-b18b-4d92855597af', '236e8a9d-368d-4245-85ce-2ab6d7ba00ce'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:12 devstack sudo[95952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:12 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:13 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.486s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:13 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Deleted volume successfully.
Sep 11 23:07:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c822b876-bc05-46f8-892d-8c1e44a9b940 tempest-VolumeSnapshotQuotasNegativeTestJSON-763005153 None] Lock "cinder-c4763459-4237-4d7d-be7b-637c848e7e96-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (67f30a40-f49c-4759-ac57-bacad9e20e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b4a33c-339b-4ff4-b81e-17b56f9c5789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b4a33c-339b-4ff4-b81e-17b56f9c5789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-848164929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d693f5-542b-47aa-8279-298ef0940c7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:14Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0213bc83-9183-4110-a864-9ebcc037e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0213bc83-9183-4110-a864-9ebcc037e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb149f6-5d00-4227-995f-a192148dfed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb149f6-5d00-4227-995f-a192148dfed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d693f5-542b-47aa-8279-298ef0940c7a', 'volume_name': 'volume-a6d693f5-542b-47aa-8279-298ef0940c7a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05189a0-959e-4aae-95c7-3d0fb1f36d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05189a0-959e-4aae-95c7-3d0fb1f36d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990d018-c186-44fd-98cb-913c5758660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Volume a6d693f5-542b-47aa-8279-298ef0940c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d693f5-542b-47aa-8279-298ef0940c7a', 'volume_size': 1}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-848164929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d693f5-542b-47aa-8279-298ef0940c7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:14Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Creating volume a6d693f5-542b-47aa-8279-298ef0940c7a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:14 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:14 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a 1073741824
Sep 11 23:07:14 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:14 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a 1073741824" returned: 0 in 0.593s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:15 devstack sudo[95961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a
Sep 11 23:07:15 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:15 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a" returned: 0 in 0.381s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3990d018-c186-44fd-98cb-913c5758660c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d693f5-542b-47aa-8279-298ef0940c7a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea41472c-fb56-45e4-8981-4de3a5b323ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Volume volume-a6d693f5-542b-47aa-8279-298ef0940c7a (a6d693f5-542b-47aa-8279-298ef0940c7a): created successfully
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea41472c-fb56-45e4-8981-4de3a5b323ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (67f30a40-f49c-4759-ac57-bacad9e20e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10ba8c0d-35bc-4426-b08d-2aae6c949a94 tempest-VolumesTestJSON-1572619743 None] Created volume successfully.
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (0f8a9eb8-ddc4-4aea-8805-585679b177bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb41d476-4e1f-4617-b6db-1613f1f6de1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb41d476-4e1f-4617-b6db-1613f1f6de1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-18859428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891b26-f1b1-4ff7-8e05-43362ecd7b63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:17Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4d5a27-e720-4bfc-a00c-1dd7a62892ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4d5a27-e720-4bfc-a00c-1dd7a62892ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcc5bf8-db47-4355-9a9d-b8210d9d25be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcc5bf8-db47-4355-9a9d-b8210d9d25be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e891b26-f1b1-4ff7-8e05-43362ecd7b63', 'volume_name': 'volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc9e926-de2d-44f6-aca5-da7ad6fe34b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc9e926-de2d-44f6-aca5-da7ad6fe34b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97605acf-8101-4fe2-9508-cd91e185cbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:17 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Volume 7e891b26-f1b1-4ff7-8e05-43362ecd7b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63', 'volume_size': 1}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-18859428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e891b26-f1b1-4ff7-8e05-43362ecd7b63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:17Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Creating volume 7e891b26-f1b1-4ff7-8e05-43362ecd7b63 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:17 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:17 devstack sudo[95965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 1073741824
Sep 11 23:07:17 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:17 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 1073741824" returned: 0 in 0.752s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:18 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63
Sep 11 23:07:18 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:18 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97605acf-8101-4fe2-9508-cd91e185cbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0adce0-cacb-4bd0-925c-8fca0725d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Volume volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 (7e891b26-f1b1-4ff7-8e05-43362ecd7b63): created successfully
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0adce0-cacb-4bd0-925c-8fca0725d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (0f8a9eb8-ddc4-4aea-8805-585679b177bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bf24cd7d-0507-4a7e-a703-1003e83b8d4d tempest-VolumesTestJSON-1572619743 None] Created volume successfully.
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (178059b8-24c0-4e75-87c5-69408c271900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edac35a4-4488-4673-baed-4ebb6ea37e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edac35a4-4488-4673-baed-4ebb6ea37e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-803394806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75a4536-cb3d-4dc4-88bd-eff0ebb2768f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:20Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e95705-b6ad-4379-9430-d1043fb884d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e95705-b6ad-4379-9430-d1043fb884d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f049e98-ca7e-46b6-a66c-ccf37c595fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f049e98-ca7e-46b6-a66c-ccf37c595fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75a4536-cb3d-4dc4-88bd-eff0ebb2768f', 'volume_name': 'volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617cd980-26e3-400f-99d2-2341b5b95949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617cd980-26e3-400f-99d2-2341b5b95949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c797b4fd-2646-42c8-b519-ce063096ebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Volume d75a4536-cb3d-4dc4-88bd-eff0ebb2768f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f', 'volume_size': 1}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-803394806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75a4536-cb3d-4dc4-88bd-eff0ebb2768f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='87f60f51f360494185b2b50d5b6f944c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:20Z,use_quota=True,user_id='58b1b815fc03446990138759de356f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Creating volume d75a4536-cb3d-4dc4-88bd-eff0ebb2768f {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:20 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:20 devstack sudo[95990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f 1073741824
Sep 11 23:07:20 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:21 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f 1073741824" returned: 0 in 0.669s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:21 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f
Sep 11 23:07:21 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:21 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c797b4fd-2646-42c8-b519-ce063096ebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4528c9d6-3cdc-444d-97b5-6d108722c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:21 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Volume volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f (d75a4536-cb3d-4dc4-88bd-eff0ebb2768f): created successfully
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4528c9d6-3cdc-444d-97b5-6d108722c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Flow 'volume_create_manager' (178059b8-24c0-4e75-87c5-69408c271900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-38c217ae-6c68-46c6-a08f-c091d285fbd4 tempest-VolumesTestJSON-1572619743 None] Created volume successfully.
Sep 11 23:07:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-quobyte-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" acquired by "delete_volume" :: waited 0.052s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c9d4a2-3e28-41e2-b6a4-65067550260c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:24 devstack sudo[96021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f
Sep 11 23:07:24 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:24 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" returned: 0 in 0.706s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:24 devstack sudo[96051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f
Sep 11 23:07:24 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:25 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" returned: 0 in 0.456s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f" released by "delete_volume" :: held 1.240s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Created reservations ['0bef6c29-3e85-450e-bbff-4fd77fb246a8', 'e74b1163-ee81-4e5e-aafb-0e9d565e0135', '8f05a23c-4138-4dc3-9d88-6baa783a9515', 'd18163a8-5f91-4b4c-81c6-51d7a22323f8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:25 devstack sudo[96056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:25 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:25 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.368s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Deleted volume successfully.
Sep 11 23:07:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-700a3424-3876-4649-9d76-981985eb6ce9 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-d75a4536-cb3d-4dc4-88bd-eff0ebb2768f-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-7e891b26-f1b1-4ff7-8e05-43362ecd7b63-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-7e891b26-f1b1-4ff7-8e05-43362ecd7b63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-quobyte-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" acquired by "delete_volume" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[165df367-a753-4b19-83f7-af56b79abe08]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:26 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63
Sep 11 23:07:26 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:27 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" returned: 0 in 0.679s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:27 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63
Sep 11 23:07:27 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:27 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" returned: 0 in 0.502s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-7e891b26-f1b1-4ff7-8e05-43362ecd7b63" released by "delete_volume" :: held 1.289s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Created reservations ['5a114328-e07e-4004-8b7d-77a410b96751', '7f848b37-3131-4c2e-9d1d-8a2adf4b049a', '2f8db331-724b-4018-bd1a-7083967204dc', '16edd8dc-56cc-4c26-a4aa-ed4e5beb6e25'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:28 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:28 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:28 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.638s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Deleted volume successfully.
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ea67b6a-d9fb-404a-bc1e-546064c3c9c5 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-7e891b26-f1b1-4ff7-8e05-43362ecd7b63-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-a6d693f5-542b-47aa-8279-298ef0940c7a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-a6d693f5-542b-47aa-8279-298ef0940c7a-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "cinder-quobyte-a6d693f5-542b-47aa-8279-298ef0940c7a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-a6d693f5-542b-47aa-8279-298ef0940c7a" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a0c617-d9cf-41ea-9129-3312de96e6fb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:29 devstack sudo[96074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a
Sep 11 23:07:29 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:29 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a" returned: 0 in 0.704s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:29 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a
Sep 11 23:07:29 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:30 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a6d693f5-542b-47aa-8279-298ef0940c7a" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-quobyte-a6d693f5-542b-47aa-8279-298ef0940c7a" released by "delete_volume" :: held 1.159s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Created reservations ['e75051b0-926d-4688-8341-80346f419c47', '0c789ff9-ae8c-432c-a18f-e49fcd2ecbed', 'f636f892-7bf7-4cac-ba0a-082828dce659', '4129e514-444e-4bd6-a468-10db67a9165e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:30 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:30 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:30 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.393s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Deleted volume successfully.
Sep 11 23:07:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ef5d5dc5-4937-42d8-b51c-0a2bdbb0f077 tempest-VolumesTestJSON-1572619743 None] Lock "cinder-a6d693f5-542b-47aa-8279-298ef0940c7a-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=73,cinder:SELECT=47,cinder:INSERT=12,cinder:DELETE=5 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=49,cinder:DELETE=4,cinder:SELECT=44,cinder:INSERT=17 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Flow 'volume_create_manager' (773cdd7e-ac8f-4a53-8402-a36abfccc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c520d816-e03b-4ec5-8873-4d104356bd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c520d816-e03b-4ec5-8873-4d104356bd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1594521000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a71ae38-708f-4bde-8449-dcda776caaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73af7033de4457c97f08b4009cf523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:41Z,use_quota=True,user_id='9e76e8caf3944e6d86b01e05aed14cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead9ea4a-05d8-425f-afc3-cd7fc81e7905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead9ea4a-05d8-425f-afc3-cd7fc81e7905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b7e6f6-d525-4140-bba1-0167e2111a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b7e6f6-d525-4140-bba1-0167e2111a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a71ae38-708f-4bde-8449-dcda776caaf5', 'volume_name': 'volume-9a71ae38-708f-4bde-8449-dcda776caaf5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf44c4b-fa05-49b6-954c-0b9289724c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf44c4b-fa05-49b6-954c-0b9289724c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0509a836-c569-4eb4-935f-c16c80cfd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Volume 9a71ae38-708f-4bde-8449-dcda776caaf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a71ae38-708f-4bde-8449-dcda776caaf5', 'volume_size': 1}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1594521000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a71ae38-708f-4bde-8449-dcda776caaf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73af7033de4457c97f08b4009cf523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:41Z,use_quota=True,user_id='9e76e8caf3944e6d86b01e05aed14cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Creating volume 9a71ae38-708f-4bde-8449-dcda776caaf5 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:41 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:41 devstack sudo[96169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 1073741824
Sep 11 23:07:41 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:41 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 1073741824" returned: 0 in 0.896s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:42 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5
Sep 11 23:07:42 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:42 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0509a836-c569-4eb4-935f-c16c80cfd523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a71ae38-708f-4bde-8449-dcda776caaf5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf78712-88e9-4012-a603-032d6d17c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:42 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Volume volume-9a71ae38-708f-4bde-8449-dcda776caaf5 (9a71ae38-708f-4bde-8449-dcda776caaf5): created successfully
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf78712-88e9-4012-a603-032d6d17c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Flow 'volume_create_manager' (773cdd7e-ac8f-4a53-8402-a36abfccc465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0d699a37-04fb-4713-be8c-aa92ef4e8c7d tempest-VolumesTransfersV355Test-855917759 None] Created volume successfully.
Sep 11 23:07:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-47c67a2a-d416-4b1e-99b8-842f35f4d393 tempest-VolumesTransfersV355Test-508563322 None] Transfer volume completed successfully.
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "cinder-9a71ae38-708f-4bde-8449-dcda776caaf5-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (8c63a86b-5a31-4e62-9592-f5b1caaf034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69428cbd-b152-4bb4-84f4-c8364c8f19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69428cbd-b152-4bb4-84f4-c8364c8f19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822666098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bd9406-1fd3-43f4-a80e-0ba4ee340fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:46Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33a5483-0308-46c3-b626-a050e6b118e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33a5483-0308-46c3-b626-a050e6b118e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8202c9e4-3569-4c30-a56e-a7d55983f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8202c9e4-3569-4c30-a56e-a7d55983f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91bd9406-1fd3-43f4-a80e-0ba4ee340fc5', 'volume_name': 'volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c30b07-0a54-42a8-aa21-b0b0c40cd3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c30b07-0a54-42a8-aa21-b0b0c40cd3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a0d4f7-83cf-4876-856c-7bde865b6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:45 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Volume 91bd9406-1fd3-43f4-a80e-0ba4ee340fc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5', 'volume_size': 1}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-822666098',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91bd9406-1fd3-43f4-a80e-0ba4ee340fc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:46Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Creating volume 91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:45 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-9a71ae38-708f-4bde-8449-dcda776caaf5-delete_volume" acquired by "delete_volume" :: waited 0.184s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:45 devstack sudo[96253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 1073741824
Sep 11 23:07:45 devstack sudo[96253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "cinder-quobyte-9a71ae38-708f-4bde-8449-dcda776caaf5" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-quobyte-9a71ae38-708f-4bde-8449-dcda776caaf5" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a788a0fc-5549-4552-8535-f6fa7a6315f3]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:46 devstack sudo[96257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:46 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:46 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5
Sep 11 23:07:46 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:46 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:07:46 devstack sudo[96253]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 1073741824" returned: 0 in 0.871s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:46 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5" returned: 0 in 0.712s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:46 devstack sudo[96269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5
Sep 11 23:07:46 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:46 devstack sudo[96271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5
Sep 11 23:07:46 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:47 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9a71ae38-708f-4bde-8449-dcda776caaf5" returned: 0 in 0.562s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-quobyte-9a71ae38-708f-4bde-8449-dcda776caaf5" released by "delete_volume" :: held 1.371s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Created reservations ['ef419e8a-071a-40af-a463-c218a6d1541b', '10d7c08b-c528-4eeb-a425-b994366c9552', '88566adf-e415-4dba-ad0d-559876897676', '41737617-8ef9-4e84-abb2-7893e11997fd'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:47 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" returned: 0 in 0.686s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a0d4f7-83cf-4876-856c-7bde865b6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71880524-fa77-420a-893d-43aaf3e695e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:47 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Volume volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 (91bd9406-1fd3-43f4-a80e-0ba4ee340fc5): created successfully
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71880524-fa77-420a-893d-43aaf3e695e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (8c63a86b-5a31-4e62-9592-f5b1caaf034d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-357ec3b2-c4d3-4a56-91c9-3c7da8f8f64d tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:47 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:47 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:48 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.639s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:48 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Deleted volume successfully.
Sep 11 23:07:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-41df43f2-a61d-4cb4-8374-22dc1971a910 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-9a71ae38-708f-4bde-8449-dcda776caaf5-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-14cdafec-6907-4d06-858e-128765e22acb tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" by "attach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-14cdafec-6907-4d06-858e-128765e22acb tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" acquired by "attach_volume" :: waited 0.045s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-14cdafec-6907-4d06-858e-128765e22acb tempest-VolumesActionsTest-654433085 None] Attaching volume 91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 to instance 06408faf-75af-4b87-9e79-839a9eadd5b8 at mountpoint /dev/vdb on host None.
Sep 11 23:07:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-14cdafec-6907-4d06-858e-128765e22acb tempest-VolumesActionsTest-654433085 None] Attach volume completed successfully.
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-14cdafec-6907-4d06-858e-128765e22acb tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" released by "attach_volume" :: held 0.262s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Flow 'volume_create_manager' (98994113-620b-4632-9536-29ec9fb3ef63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a160e17-f8e5-4fbb-bcab-b0af3eb2924b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a160e17-f8e5-4fbb-bcab-b0af3eb2924b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521094304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af37d69-f0b2-4ac4-9508-d726f9eebe12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73af7033de4457c97f08b4009cf523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:50Z,use_quota=True,user_id='9e76e8caf3944e6d86b01e05aed14cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d9417d-10e1-4aa9-a509-290977e84fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d9417d-10e1-4aa9-a509-290977e84fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f8b7f-01ce-4077-b8d2-16a55abdd453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19f8b7f-01ce-4077-b8d2-16a55abdd453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af37d69-f0b2-4ac4-9508-d726f9eebe12', 'volume_name': 'volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8823828-8069-4655-9ced-5b6f82f3de87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8823828-8069-4655-9ced-5b6f82f3de87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb7b529-9908-44f6-9262-810ea156ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:49 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Volume 7af37d69-f0b2-4ac4-9508-d726f9eebe12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12', 'volume_size': 1}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-521094304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af37d69-f0b2-4ac4-9508-d726f9eebe12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c73af7033de4457c97f08b4009cf523b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:07:50Z,use_quota=True,user_id='9e76e8caf3944e6d86b01e05aed14cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Creating volume 7af37d69-f0b2-4ac4-9508-d726f9eebe12 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:07:49 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:07:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:49 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 1073741824
Sep 11 23:07:49 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Terminate volume connection completed successfully.
Sep 11 23:07:50 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" by "detach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 1073741824" returned: 0 in 1.155s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" acquired by "detach_volume" :: waited 0.078s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Detaching volume 91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 from instance 06408faf-75af-4b87-9e79-839a9eadd5b8.
Sep 11 23:07:51 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12
Sep 11 23:07:51 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Detach volume completed successfully.
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7d32a565-64e0-4598-9c3a-fc390f3049d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" released by "detach_volume" :: held 0.313s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:51 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb7b529-9908-44f6-9262-810ea156ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825c9595-09d2-4a19-abab-86439396c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:07:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Volume volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 (7af37d69-f0b2-4ac4-9508-d726f9eebe12): created successfully
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825c9595-09d2-4a19-abab-86439396c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Flow 'volume_create_manager' (98994113-620b-4632-9536-29ec9fb3ef63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:07:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e88fad91-1be0-419f-912b-0f38b88a4dc5 tempest-VolumesTransfersV355Test-855917759 None] Created volume successfully.
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7293e26a-edbb-40b8-97cd-3c8584f77410 tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" by "detach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7293e26a-edbb-40b8-97cd-3c8584f77410 tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7293e26a-edbb-40b8-97cd-3c8584f77410 tempest-VolumesActionsTest-654433085 None] Volume detach called, but volume not attached.
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7293e26a-edbb-40b8-97cd-3c8584f77410 tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-quobyte-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "cinder-quobyte-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[962aa968-809c-4d27-b7f4-124ea1845c7c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:52 devstack sudo[96331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5
Sep 11 23:07:52 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:53 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" returned: 0 in 0.585s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:53 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5
Sep 11 23:07:53 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "cinder-7af37d69-f0b2-4ac4-9508-d726f9eebe12-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-7af37d69-f0b2-4ac4-9508-d726f9eebe12-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "cinder-quobyte-7af37d69-f0b2-4ac4-9508-d726f9eebe12" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-quobyte-7af37d69-f0b2-4ac4-9508-d726f9eebe12" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1500d20-01bf-4758-a2e4-1ad52321d77d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:53 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" returned: 0 in 0.474s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "cinder-quobyte-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5" released by "delete_volume" :: held 1.120s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:53 devstack sudo[96339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12
Sep 11 23:07:53 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:53 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Created reservations ['5e2de736-0ae2-4ce0-b893-2a98e461c2d2', '917f7208-d2a3-4d5a-9f40-8d3d7dae56b6', '3c6678ea-09b8-43f3-8521-d10ce131526a', 'b15146c2-349f-4f7c-8f16-43cfe6a13115'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:54 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:54 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:54 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12" returned: 0 in 0.705s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:54 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12
Sep 11 23:07:54 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:54 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.558s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Deleted volume successfully.
Sep 11 23:07:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-50f8840d-2543-44f8-abe5-56bfcfa07535 tempest-VolumesActionsTest-654433085 None] Lock "cinder-91bd9406-1fd3-43f4-a80e-0ba4ee340fc5-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:54 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7af37d69-f0b2-4ac4-9508-d726f9eebe12" returned: 0 in 0.590s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-quobyte-7af37d69-f0b2-4ac4-9508-d726f9eebe12" released by "delete_volume" :: held 1.397s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Created reservations ['8b779bcb-933a-4c57-93ae-d92d7051ddd7', '10442545-e97c-40be-ab12-2c4dcda1352b', 'c0a93920-845b-4e44-bf6a-f91a5933d7dd', '8ea6623e-e929-4af2-b162-822a9a2510b8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:07:55 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:07:55 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:07:55 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.429s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:07:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Deleted volume successfully.
Sep 11 23:07:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cf162a4a-888b-4ca7-9035-3f3df09c7264 tempest-VolumesTransfersV355Test-537252468 None] Lock "cinder-7af37d69-f0b2-4ac4-9508-d726f9eebe12-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:07:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-cd1b0f5b-a907-472b-885d-d268ff79b119 req-5c9a6d4c-78ea-4fef-8892-947ad013ddcb tempest-AttachVolumeNegativeTest-2066173202 None] Terminate volume connection completed successfully.
Sep 11 23:07:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-cd1b0f5b-a907-472b-885d-d268ff79b119 req-5c9a6d4c-78ea-4fef-8892-947ad013ddcb tempest-AttachVolumeNegativeTest-2066173202 None] Deleting attachment 898fad1a-27a6-48f2-808d-8aabbbb598fe. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (b2032011-4c0b-4295-92de-ac2fcdf60f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce6d6bb-213d-4f46-aa3f-55a99778e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ce6d6bb-213d-4f46-aa3f-55a99778e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877095835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf95049-22dd-4108-8f36-6ca9aeb53b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:00Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f2fa9f-7193-4ba5-9faf-54d5faf7ba4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f2fa9f-7193-4ba5-9faf-54d5faf7ba4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a308601-11f8-49b3-98a1-80d125e10cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a308601-11f8-49b3-98a1-80d125e10cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf95049-22dd-4108-8f36-6ca9aeb53b2f', 'volume_name': 'volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8915e-84b2-4c26-9587-7ad6d3062a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8915e-84b2-4c26-9587-7ad6d3062a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9124d41-42e2-4b7a-af0c-78b026b50db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Volume ebf95049-22dd-4108-8f36-6ca9aeb53b2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f', 'volume_size': 1}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-877095835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf95049-22dd-4108-8f36-6ca9aeb53b2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:00Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Creating volume ebf95049-22dd-4108-8f36-6ca9aeb53b2f {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:00 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:00 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f 1073741824
Sep 11 23:08:00 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:01 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f 1073741824" returned: 0 in 0.665s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:01 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f
Sep 11 23:08:01 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:01 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9124d41-42e2-4b7a-af0c-78b026b50db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c9c1e-9f95-4573-9655-be84eaf7b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Volume volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f (ebf95049-22dd-4108-8f36-6ca9aeb53b2f): created successfully
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c9c1e-9f95-4573-9655-be84eaf7b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (b2032011-4c0b-4295-92de-ac2fcdf60f46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e79722b4-2075-4cb6-8c07-7472755bbed6 tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-ebf95049-22dd-4108-8f36-6ca9aeb53b2f-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-ebf95049-22dd-4108-8f36-6ca9aeb53b2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-quobyte-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" acquired by "delete_volume" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08cd01f-c1ff-4d15-9270-4c902f77f9ac]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:03 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f
Sep 11 23:08:03 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:03 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:03 devstack sudo[96416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f
Sep 11 23:08:03 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:03 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-ebf95049-22dd-4108-8f36-6ca9aeb53b2f" released by "delete_volume" :: held 0.889s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Created reservations ['e02715ad-e7a8-44cb-a220-c1b681dd35de', 'be8c6d9b-a74a-4cc7-a9be-0afbb7c09520', 'f8e6125f-1a96-4bbc-afb4-724aea67bcd0', '1854298d-79a2-42e0-bcd9-990323eba6d9'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:03 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:03 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:04 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.340s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:04 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Deleted volume successfully.
Sep 11 23:08:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f183f72-a3a6-461f-9e80-031c9ef2f3f4 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-ebf95049-22dd-4108-8f36-6ca9aeb53b2f-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (384a4128-726b-417b-852c-03596db3bf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd16b1d1-20aa-4f2a-9ff6-8fe1585db3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd16b1d1-20aa-4f2a-9ff6-8fe1585db3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52029313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0995de-85ed-43c1-b8a7-e9ea569fcd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:05Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eadb96-3ca4-492e-9f4f-9558482fb839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eadb96-3ca4-492e-9f4f-9558482fb839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf32123-c9d8-41c5-8c15-c0488acd848e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf32123-c9d8-41c5-8c15-c0488acd848e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0995de-85ed-43c1-b8a7-e9ea569fcd10', 'volume_name': 'volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063ea07-306a-4b83-8341-abb4a63e518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0063ea07-306a-4b83-8341-abb4a63e518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11afb133-466e-439f-9105-236eadb09c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:05 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Volume 1d0995de-85ed-43c1-b8a7-e9ea569fcd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10', 'volume_size': 1}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-52029313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0995de-85ed-43c1-b8a7-e9ea569fcd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:05Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Creating volume 1d0995de-85ed-43c1-b8a7-e9ea569fcd10 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:05 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:05 devstack sudo[96460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 1073741824
Sep 11 23:08:05 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:05 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 1073741824" returned: 0 in 0.657s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:05 devstack sudo[96466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10
Sep 11 23:08:05 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (9cd1f3ef-458f-4550-ad3b-47324dc429a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658822ba-74a3-4a7f-8304-94c6de69c668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658822ba-74a3-4a7f-8304-94c6de69c668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1630648641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a751ff-1e12-48af-ba3e-f48defd3fa29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:06Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e06810-5264-40a6-aad5-e40a57a3e435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e06810-5264-40a6-aad5-e40a57a3e435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea993d5f-bf9d-42bb-a5c2-2cd2934ef720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea993d5f-bf9d-42bb-a5c2-2cd2934ef720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2a751ff-1e12-48af-ba3e-f48defd3fa29', 'volume_name': 'volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714af9d1-0a21-4ff9-883a-133b86b58d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714af9d1-0a21-4ff9-883a-133b86b58d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30063836-4f1f-4b83-94bc-dc7cc310130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Volume f2a751ff-1e12-48af-ba3e-f48defd3fa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29', 'volume_size': 1}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" returned: 0 in 0.367s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1630648641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a751ff-1e12-48af-ba3e-f48defd3fa29,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:06Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Creating volume f2a751ff-1e12-48af-ba3e-f48defd3fa29 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:06 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11afb133-466e-439f-9105-236eadb09c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 1073741824
Sep 11 23:08:06 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28752d59-521d-405e-b30b-db3465d75be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Volume volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 (1d0995de-85ed-43c1-b8a7-e9ea569fcd10): created successfully
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28752d59-521d-405e-b30b-db3465d75be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (384a4128-726b-417b-852c-03596db3bf44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eb675d0c-bbeb-49af-9b0a-cac87eae786f tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:08:06 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 1073741824" returned: 0 in 0.529s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:06 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29
Sep 11 23:08:06 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Flow 'volume_create_manager' (931d8775-9eee-4e15-b72a-3125a3eb6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:07 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59691cc0-5b39-4774-b6c9-d0767fe425db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29" returned: 0 in 0.416s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59691cc0-5b39-4774-b6c9-d0767fe425db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1123221419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aea47c9-9d79-45d5-ab72-df909f175564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd8802ff8c04f8ca37f3e54975bc08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:07Z,use_quota=True,user_id='bd983de8cce24331aa434fc4e11363a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f67a6fe-c892-45e5-8367-75908ef0770d),volume_type_id=7f67a6fe-c892-45e5-8367-75908ef0770d)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fa9ac3-fe0c-479c-99ad-e276b058e104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fa9ac3-fe0c-479c-99ad-e276b058e104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2990d-2431-46f3-b2b4-dbaf76963da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2990d-2431-46f3-b2b4-dbaf76963da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aea47c9-9d79-45d5-ab72-df909f175564', 'volume_name': 'volume-1aea47c9-9d79-45d5-ab72-df909f175564', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d952674-7ae3-41c0-b131-fad15306da57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d952674-7ae3-41c0-b131-fad15306da57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43239833-da4c-4185-a162-47deab40df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Volume 1aea47c9-9d79-45d5-ab72-df909f175564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aea47c9-9d79-45d5-ab72-df909f175564', 'volume_size': 1}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1123221419',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aea47c9-9d79-45d5-ab72-df909f175564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fd8802ff8c04f8ca37f3e54975bc08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:07Z,use_quota=True,user_id='bd983de8cce24331aa434fc4e11363a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f67a6fe-c892-45e5-8367-75908ef0770d),volume_type_id=7f67a6fe-c892-45e5-8367-75908ef0770d)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Creating volume 1aea47c9-9d79-45d5-ab72-df909f175564 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-1d0995de-85ed-43c1-b8a7-e9ea569fcd10-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:07 devstack sudo[96481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 1073741824
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30063836-4f1f-4b83-94bc-dc7cc310130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb25e745-c981-41c1-9a2e-4446a536d70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Volume volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 (f2a751ff-1e12-48af-ba3e-f48defd3fa29): created successfully
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb25e745-c981-41c1-9a2e-4446a536d70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (9cd1f3ef-458f-4550-ad3b-47324dc429a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-1d0995de-85ed-43c1-b8a7-e9ea569fcd10-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-398971f3-ae33-434e-8575-1a7623c1d880 tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-quobyte-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f304bb4-4da7-47ff-a5cc-6b63fbaac71b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:07 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10
Sep 11 23:08:07 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:07 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 1073741824" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:07 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:07 devstack sudo[96493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564
Sep 11 23:08:07 devstack sudo[96493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" returned: 0 in 0.438s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:08 devstack sudo[96495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10
Sep 11 23:08:08 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:08 devstack sudo[96493]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43239833-da4c-4185-a162-47deab40df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aea47c9-9d79-45d5-ab72-df909f175564', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea09a9a-0562-4b99-a5d9-8c5963f9142d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Volume volume-1aea47c9-9d79-45d5-ab72-df909f175564 (1aea47c9-9d79-45d5-ab72-df909f175564): created successfully
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea09a9a-0562-4b99-a5d9-8c5963f9142d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Flow 'volume_create_manager' (931d8775-9eee-4e15-b72a-3125a3eb6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9671d308-5b24-418b-a620-50d6b07c5479 tempest-VolumeTypesAccessTest-1016029806 None] Created volume successfully.
Sep 11 23:08:08 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" returned: 0 in 0.447s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-1d0995de-85ed-43c1-b8a7-e9ea569fcd10" released by "delete_volume" :: held 0.948s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Created reservations ['3ebe535b-9796-4826-99ce-27a6b0ca0e61', 'b1efce25-e791-4abe-a5c9-65e8aaca6df7', '408f049f-4fc6-4cda-bc76-e7b0fe7c9e8b', 'e9334f00-a387-4fee-bd90-8e06a9c20542'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:08 devstack sudo[96500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:08 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:09 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.330s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Deleted volume successfully.
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-65fedf4d-4b9f-48be-85b3-de2953c4b2d7 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-1d0995de-85ed-43c1-b8a7-e9ea569fcd10-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (81c2b6ab-08e0-430e-aeec-8c840976affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c269e2-40fa-485f-9a83-426661fcb7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c269e2-40fa-485f-9a83-426661fcb7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2120050104',display_name='tempest-VolumesGetTest-Volume-522078092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a06942-e68f-4cdf-9da5-c215e1adcd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:09Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b2b282-1484-4005-98ea-1755ef3607f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9b2b282-1484-4005-98ea-1755ef3607f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ebfc58-864c-48a5-a898-14d784acfc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ebfc58-864c-48a5-a898-14d784acfc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a06942-e68f-4cdf-9da5-c215e1adcd53', 'volume_name': 'volume-02a06942-e68f-4cdf-9da5-c215e1adcd53', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efda0dbb-c7e2-4481-8c58-5e4762b4f87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efda0dbb-c7e2-4481-8c58-5e4762b4f87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b5b88c-a183-4339-848b-c3e7e727d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Volume 02a06942-e68f-4cdf-9da5-c215e1adcd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a06942-e68f-4cdf-9da5-c215e1adcd53', 'volume_size': 1}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2120050104',display_name='tempest-VolumesGetTest-Volume-522078092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a06942-e68f-4cdf-9da5-c215e1adcd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:09Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Creating volume 02a06942-e68f-4cdf-9da5-c215e1adcd53 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:09 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Acquiring lock "cinder-1aea47c9-9d79-45d5-ab72-df909f175564-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:09 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 1073741824
Sep 11 23:08:09 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "cinder-1aea47c9-9d79-45d5-ab72-df909f175564-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Acquiring lock "cinder-quobyte-1aea47c9-9d79-45d5-ab72-df909f175564" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "cinder-quobyte-1aea47c9-9d79-45d5-ab72-df909f175564" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cede7f6-3bd4-443a-aa89-1ed579b4713d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:09 devstack sudo[96520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564
Sep 11 23:08:09 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:10 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 1073741824" returned: 0 in 0.568s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:10 devstack sudo[96529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53
Sep 11 23:08:10 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:10 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564" returned: 0 in 0.510s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:10 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564
Sep 11 23:08:10 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (e41e8742-5cd1-415d-af5b-1d458a184eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1422b54c-11d9-46b6-9fed-864efcd77497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1422b54c-11d9-46b6-9fed-864efcd77497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411018821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ee9318-fa72-4e0f-bead-e72c8ac0e757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:10Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d521f2f-40f3-4337-a0f5-f26478f2e2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d521f2f-40f3-4337-a0f5-f26478f2e2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535535d5-59be-4cc2-812d-e75569253a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (535535d5-59be-4cc2-812d-e75569253a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ee9318-fa72-4e0f-bead-e72c8ac0e757', 'volume_name': 'volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc0bda-0944-4bf1-b252-aa40b6135ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eacc0bda-0944-4bf1-b252-aa40b6135ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ec8dc5-7958-4f15-845f-2e7203ee0077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Volume 92ee9318-fa72-4e0f-bead-e72c8ac0e757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757', 'volume_size': 1}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:10 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53" returned: 0 in 0.329s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.051s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-411018821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ee9318-fa72-4e0f-bead-e72c8ac0e757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:10Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Creating volume 92ee9318-fa72-4e0f-bead-e72c8ac0e757 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b5b88c-a183-4339-848b-c3e7e727d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a06942-e68f-4cdf-9da5-c215e1adcd53', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack sudo[96534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 1073741824
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cd5c81-5bb6-4909-9487-d9ddb08aa0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:10 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Volume volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 (02a06942-e68f-4cdf-9da5-c215e1adcd53): created successfully
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cd5c81-5bb6-4909-9487-d9ddb08aa0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:10 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (81c2b6ab-08e0-430e-aeec-8c840976affe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1aea47c9-9d79-45d5-ab72-df909f175564" returned: 0 in 0.411s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "cinder-quobyte-1aea47c9-9d79-45d5-ab72-df909f175564" released by "delete_volume" :: held 1.015s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2a45f2c9-0953-4b49-95e5-12bcbf138a3b tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:10 devstack cinder-volume[88022]: WARNING cinder.quota [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-878853867 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-878853867, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:08:10 devstack cinder-volume[88022]: WARNING cinder.quota [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-878853867 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-878853867, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Created reservations ['7d59169b-2ef4-4cc8-aebb-79bfba96d532', '28557cdb-3d91-4288-b202-ef95005af2e6', 'b0542d0a-2eff-4ff9-a107-1b7161b0a1ff', '9f7ce294-70b4-4657-8e56-d198b0bf3685'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:11 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:11 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:11 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 1073741824" returned: 0 in 0.635s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:11 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757
Sep 11 23:08:11 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:11 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Deleted volume successfully.
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dabdd764-6b7a-4215-a0c6-bfe80de52c8f tempest-VolumeTypesAccessTest-1016029806 None] Lock "cinder-1aea47c9-9d79-45d5-ab72-df909f175564-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:11 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757" returned: 0 in 0.304s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51ec8dc5-7958-4f15-845f-2e7203ee0077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb0995f-e0b5-4a05-ad63-7bfddb87b739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Volume volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 (92ee9318-fa72-4e0f-bead-e72c8ac0e757): created successfully
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb0995f-e0b5-4a05-ad63-7bfddb87b739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (e41e8742-5cd1-415d-af5b-1d458a184eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1022fa5f-db56-4b57-af65-e5e8cc7f8450 tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-02a06942-e68f-4cdf-9da5-c215e1adcd53-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "cinder-02a06942-e68f-4cdf-9da5-c215e1adcd53-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-02a06942-e68f-4cdf-9da5-c215e1adcd53" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-02a06942-e68f-4cdf-9da5-c215e1adcd53" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c00531-cdcd-41ba-a43f-1041b669888a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:12 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53
Sep 11 23:08:12 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:12 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53" returned: 0 in 0.873s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:12 devstack sudo[96612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53
Sep 11 23:08:12 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-92ee9318-fa72-4e0f-bead-e72c8ac0e757-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-92ee9318-fa72-4e0f-bead-e72c8ac0e757-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-quobyte-92ee9318-fa72-4e0f-bead-e72c8ac0e757" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-92ee9318-fa72-4e0f-bead-e72c8ac0e757" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:13 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-02a06942-e68f-4cdf-9da5-c215e1adcd53" returned: 0 in 0.546s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f2d4f-7007-49fa-a62e-8325cc351c73]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-02a06942-e68f-4cdf-9da5-c215e1adcd53" released by "delete_volume" :: held 1.555s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Created reservations ['9011bed2-607d-4728-9306-4cee330e4c0f', 'e9d56cbc-16e8-4a8b-a33b-e904a81d6d56', '971427a2-54ee-435b-ace4-a97e73d14893', '4b43413f-8b43-484a-848e-2ff86a351b91'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:13 devstack sudo[96622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757
Sep 11 23:08:13 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:13 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:13 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:13 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757" returned: 0 in 0.549s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:13 devstack sudo[96633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757
Sep 11 23:08:13 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:13 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.446s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:13 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fa6ce398-bbb3-4060-a0d5-62ae5bbb9f0f tempest-VolumesGetTest-435678142 None] Lock "cinder-02a06942-e68f-4cdf-9da5-c215e1adcd53-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-f2a751ff-1e12-48af-ba3e-f48defd3fa29-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "cinder-f2a751ff-1e12-48af-ba3e-f48defd3fa29-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-f2a751ff-1e12-48af-ba3e-f48defd3fa29" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-f2a751ff-1e12-48af-ba3e-f48defd3fa29" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:14 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-92ee9318-fa72-4e0f-bead-e72c8ac0e757" returned: 0 in 0.673s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8653c74-8aa9-4ed5-9dcc-fc3e4c7e8188]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-92ee9318-fa72-4e0f-bead-e72c8ac0e757" released by "delete_volume" :: held 1.338s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Created reservations ['86400342-bda3-4dd5-a391-500a683a75ed', '2e6d809b-82a5-4877-a51a-d95481763ad4', '2bcbe894-a935-4267-b535-ff9749f0a5cd', '78330e2e-a0ab-4df3-b9d8-e37f0c30773e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:14 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29
Sep 11 23:08:14 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:14 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:14 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:15 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29" returned: 0 in 0.531s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:15 devstack sudo[96643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29
Sep 11 23:08:15 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:15 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Deleted volume successfully.
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e94b74c1-d7e9-45a7-a8b3-970281fb5302 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-92ee9318-fa72-4e0f-bead-e72c8ac0e757-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:15 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f2a751ff-1e12-48af-ba3e-f48defd3fa29" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-f2a751ff-1e12-48af-ba3e-f48defd3fa29" released by "delete_volume" :: held 1.040s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Created reservations ['21a73e7d-ef07-4d0f-9ab7-19726879edb8', '1b67473a-930c-4307-bc3b-dfc498ea10d9', '5d0cf22e-0331-41bd-886a-9d25abdc73a0', 'c0e5b22f-582d-47c3-baad-466c9b41e6c7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:15 devstack sudo[96648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:15 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:16 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.543s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0e03f11e-2667-4002-95a3-7584f09e0af2 tempest-VolumesGetTest-435678142 None] Lock "cinder-f2a751ff-1e12-48af-ba3e-f48defd3fa29-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (974225f3-1a26-4d2f-ad10-27989f1b1ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0851f289-e61a-4805-bbe3-5e0daba61758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0851f289-e61a-4805-bbe3-5e0daba61758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1953546246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e3f515-5292-4702-8391-cfdefeed6708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:16Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3d8ee7-adef-4079-887b-4f6a75955d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3d8ee7-adef-4079-887b-4f6a75955d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf33323-4a9d-4199-9bee-a29f7e741583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf33323-4a9d-4199-9bee-a29f7e741583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78e3f515-5292-4702-8391-cfdefeed6708', 'volume_name': 'volume-78e3f515-5292-4702-8391-cfdefeed6708', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8571927b-fe15-448b-8fb6-9e60c9cd9e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8571927b-fe15-448b-8fb6-9e60c9cd9e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a15efd-1103-41c1-950a-50f0c285fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Volume 78e3f515-5292-4702-8391-cfdefeed6708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78e3f515-5292-4702-8391-cfdefeed6708', 'volume_size': 1}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1953546246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78e3f515-5292-4702-8391-cfdefeed6708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:16Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Creating volume 78e3f515-5292-4702-8391-cfdefeed6708 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:16 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:16 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 1073741824
Sep 11 23:08:16 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:17 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 1073741824" returned: 0 in 1.008s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:17 devstack sudo[96656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708
Sep 11 23:08:17 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:17 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (6f2ac245-60bc-41ef-9403-1be4b2052b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c41fd32-c5d1-4d13-a0af-6086310a9cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c41fd32-c5d1-4d13-a0af-6086310a9cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1823976493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:18Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce50854-d2d2-4a1d-8e59-91c2f6ffc9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce50854-d2d2-4a1d-8e59-91c2f6ffc9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1ff262-119f-4584-b0f0-58e305a48637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1ff262-119f-4584-b0f0-58e305a48637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'volume_name': 'volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba60e5-e368-4fca-b3dd-cc1e670af2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ba60e5-e368-4fca-b3dd-cc1e670af2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ebb19d-089e-4b80-bda7-8932a95c62f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Volume 8b2a52bd-96ae-4617-b8c2-9448ccbe57ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'volume_size': 1}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:18 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708" returned: 0 in 0.537s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.162s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1823976493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:18Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Creating volume 8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:18 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:18 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec 1073741824
Sep 11 23:08:18 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0a15efd-1103-41c1-950a-50f0c285fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78e3f515-5292-4702-8391-cfdefeed6708', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08531b09-2d4d-4f20-ae7e-3e07ab713064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Volume volume-78e3f515-5292-4702-8391-cfdefeed6708 (78e3f515-5292-4702-8391-cfdefeed6708): created successfully
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08531b09-2d4d-4f20-ae7e-3e07ab713064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (974225f3-1a26-4d2f-ad10-27989f1b1ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-291b7a53-9e99-4124-8926-293b6145f577 tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:08:19 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec 1073741824" returned: 0 in 0.953s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:19 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:19 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:19 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.614s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ebb19d-089e-4b80-bda7-8932a95c62f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460d7e1e-a996-4df4-b9e1-4abbc01d5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Volume volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec (8b2a52bd-96ae-4617-b8c2-9448ccbe57ec): created successfully
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460d7e1e-a996-4df4-b9e1-4abbc01d5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (6f2ac245-60bc-41ef-9403-1be4b2052b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6ae9797d-f62a-4ca0-bf05-75afca08a7fc tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-78e3f515-5292-4702-8391-cfdefeed6708-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-78e3f515-5292-4702-8391-cfdefeed6708-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "cinder-quobyte-78e3f515-5292-4702-8391-cfdefeed6708" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-78e3f515-5292-4702-8391-cfdefeed6708" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef77f6-207b-41e3-b6da-c739058baf69]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:20 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708
Sep 11 23:08:20 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:20 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708" returned: 0 in 0.439s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:20 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708
Sep 11 23:08:20 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:21 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-78e3f515-5292-4702-8391-cfdefeed6708" returned: 0 in 0.330s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-quobyte-78e3f515-5292-4702-8391-cfdefeed6708" released by "delete_volume" :: held 0.824s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Created reservations ['bdd107e2-0af6-4801-8d9d-c9a11afa2cd9', '62ba62a6-5ec0-4bbf-9da4-bbbba86c6cad', '9626d8e7-49d2-48cf-bea9-8be780eaf1c0', 'b9391c41-d0e2-45d0-8372-0ac83f82d7fa'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:21 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:21 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (20e35dbd-8a4d-44f2-9a24-eac3cbeb9669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:21 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab61e306-1685-444d-99f3-7b361ea93f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.510s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab61e306-1685-444d-99f3-7b361ea93f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-30662799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253f8c1a-e14f-4731-84f7-bdf7e0a1f20e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:22Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c8d0f-c03e-4a0f-affe-1c02435d7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (298c8d0f-c03e-4a0f-affe-1c02435d7884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001b41e-bc22-4d2f-8a7f-dbcc48a68b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Deleted volume successfully.
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001b41e-bc22-4d2f-8a7f-dbcc48a68b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '253f8c1a-e14f-4731-84f7-bdf7e0a1f20e', 'volume_name': 'volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e', 'volume_size': 1, 'source_volid': '8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'source_volstatus': 'available'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e5576-0aab-4ac0-a569-7dfcc7c607ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1e5576-0aab-4ac0-a569-7dfcc7c607ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890216b1-3089-495d-8ad5-e1732c64daca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Volume 253f8c1a-e14f-4731-84f7-bdf7e0a1f20e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e', 'volume_size': 1, 'source_volid': '8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'source_volstatus': 'available'}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a57450a0-17db-42c4-9dd4-2714b99acd36 tempest-VolumesActionsTest-1928099766 None] Lock "cinder-78e3f515-5292-4702-8391-cfdefeed6708-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:22 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Cloning volume 8b2a52bd-96ae-4617-b8c2-9448ccbe57ec to volume 253f8c1a-e14f-4731-84f7-bdf7e0a1f20e
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Creating offline snapshot 374f272f-16f3-46d6-8159-722745b77c01 of volume 8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c2e443-671d-4a2b-9a4a-f73570d89b2a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:22 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:22 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (9013fe36-3dc5-466f-b659-6c322682b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2b437b-c89b-4560-8c14-71c9493c219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2b437b-c89b-4560-8c14-71c9493c219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422464530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd64fd47-27d5-4da8-b198-8ed46939b2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:23Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61d2c2a-6709-4860-a4ff-733b45fd9786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61d2c2a-6709-4860-a4ff-733b45fd9786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084ce3f4-fc89-4739-aa6b-3beb64403e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084ce3f4-fc89-4739-aa6b-3beb64403e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd64fd47-27d5-4da8-b198-8ed46939b2a7', 'volume_name': 'volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c47b5-1c64-4c22-aed9-8b81f9eb44bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093c47b5-1c64-4c22-aed9-8b81f9eb44bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0b7338-f692-47d5-83e9-820c4f600d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Volume bd64fd47-27d5-4da8-b198-8ed46939b2a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7', 'volume_size': 1}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.577s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:22 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 1G
Sep 11 23:08:22 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:23 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 1G" returned: 0 in 0.463s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:23 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:23 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:23 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.353s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:23 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 is being set with open permissions: ugo+rw
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:23 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:23 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:23 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.308s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:23 devstack sudo[96706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info
Sep 11 23:08:23 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:24 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info" returned: 0 in 0.289s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:24 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info is being set with open permissions: ugo+rw
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:24 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info
Sep 11 23:08:24 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:24 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.info" returned: 0 in 0.275s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] snapshot: 374f272f-16f3-46d6-8159-722745b77c01, volume: 253f8c1a-e14f-4731-84f7-bdf7e0a1f20e,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a593a877-f2c6-4c6f-81f4-cb9233b0340d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:24 devstack sudo[96712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:24 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:25 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.428s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d68bc9-de9d-4778-8bc0-6ac98591fa43]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:25 devstack sudo[96717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:25 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:25 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:08:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:25 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e
Sep 11 23:08:25 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:30 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" returned: 0 in 5.415s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:30 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:08:30 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Converted 1024.00 MB image at 189.05 MB/s
Sep 11 23:08:30 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e is being set with open permissions: ugo+rw
Sep 11 23:08:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:30 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e
Sep 11 23:08:30 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:31 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" released by "_copy_volume_from_snapshot" :: held 6.640s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-374f272f-16f3-46d6-8159-722745b77c01" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-374f272f-16f3-46d6-8159-722745b77c01" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Deleting offline snapshot 374f272f-16f3-46d6-8159-722745b77c01 of volume 8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] snapshot_file for this snap is: volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef13df2a-888c-41fb-aa7e-a1d3dd7f2708]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:31 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:31 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:31 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9b2f8-bf9d-4e4b-9db8-688288d6ebb9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:31 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:31 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:32 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.553s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:32 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:32 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:32 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.353s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:32 devstack sudo[96769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01
Sep 11 23:08:32 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:32 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec.374f272f-16f3-46d6-8159-722745b77c01" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-374f272f-16f3-46d6-8159-722745b77c01" released by "_delete_snapshot" :: held 1.666s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.793s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.150s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1422464530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd64fd47-27d5-4da8-b198-8ed46939b2a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='396287675f9c48faafb4c266b40402c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:23Z,use_quota=True,user_id='86d245183e824179b7fc6cfd3c2d52e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Creating volume bd64fd47-27d5-4da8-b198-8ed46939b2a7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:32 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:32 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 1073741824
Sep 11 23:08:32 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (890216b1-3089-495d-8ad5-e1732c64daca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e', 'volume_size': 1, 'source_volid': '8b2a52bd-96ae-4617-b8c2-9448ccbe57ec', 'source_volstatus': 'available'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac6793d-6690-4057-a0ef-1321dc3eb3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Volume volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e (253f8c1a-e14f-4731-84f7-bdf7e0a1f20e): created successfully
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac6793d-6690-4057-a0ef-1321dc3eb3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (20e35dbd-8a4d-44f2-9a24-eac3cbeb9669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5f2304c6-b9b0-431b-a2c6-828c36712b11 tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:33 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 1073741824" returned: 0 in 0.500s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:33 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7
Sep 11 23:08:33 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:33 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7" returned: 0 in 0.290s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0b7338-f692-47d5-83e9-820c4f600d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b59347-cf32-4187-b33a-dba117c1ae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Volume volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 (bd64fd47-27d5-4da8-b198-8ed46939b2a7): created successfully
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b59347-cf32-4187-b33a-dba117c1ae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Flow 'volume_create_manager' (9013fe36-3dc5-466f-b659-6c322682b983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-093d65ee-f6b5-46ff-b334-1f6bf0cda9c0 tempest-VolumesActionsTest-654433085 None] Created volume successfully.
Sep 11 23:08:33 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Flow 'volume_create_manager' (5ce46b0e-63ce-46b2-b56b-d46f5b4b9a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946db2b-3957-490b-b202-312fd8b491a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1946db2b-3957-490b-b202-312fd8b491a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-744702665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c848d-665e-41d9-bb32-16db107a6806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109d9c55357d409a8f0b7461f544a386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:34Z,use_quota=True,user_id='60ee67a563b54ef794c86cb714ee1d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8686c2-9cca-49ca-aa53-89fceddfd9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8686c2-9cca-49ca-aa53-89fceddfd9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc212577-6995-4b33-a768-509d35f4c176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc212577-6995-4b33-a768-509d35f4c176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d1c848d-665e-41d9-bb32-16db107a6806', 'volume_name': 'volume-8d1c848d-665e-41d9-bb32-16db107a6806', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb647ac30>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e876b58d-69fd-40c6-b579-e2f5f414c91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e876b58d-69fd-40c6-b579-e2f5f414c91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ea596c-d841-43ca-8ae7-b45cbecc63e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Volume 8d1c848d-665e-41d9-bb32-16db107a6806: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d1c848d-665e-41d9-bb32-16db107a6806', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb647ac30>}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Trying to clone 8d1c848d-665e-41d9-bb32-16db107a6806 from image 414d8567-5d24-440f-be04-3f648fa33a01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:08:34 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (7c7c41d4-1358-4a51-92c3-0efba4d88d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bea1f16-5bad-4692-b145-4e96ec473372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bea1f16-5bad-4692-b145-4e96ec473372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-830216284',display_name='tempest-VolumesGetTest-Volume-1021597438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56f251-cd68-4e8f-b5c8-2801ce3b1934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:35Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737d08a0-88f8-4fb9-a43b-edf9bc2d0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737d08a0-88f8-4fb9-a43b-edf9bc2d0553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb43d3-57c0-4595-8cea-b025ba5e3ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cccb43d3-57c0-4595-8cea-b025ba5e3ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a56f251-cd68-4e8f-b5c8-2801ce3b1934', 'volume_name': 'volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93871655-869f-49bd-b73f-e761636a7339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93871655-869f-49bd-b73f-e761636a7339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaba129-9ffa-4b7e-bcf9-cc29ba3f222a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:34 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Volume 5a56f251-cd68-4e8f-b5c8-2801ce3b1934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934', 'volume_size': 1}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-830216284',display_name='tempest-VolumesGetTest-Volume-1021597438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56f251-cd68-4e8f-b5c8-2801ce3b1934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:35Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Creating volume 5a56f251-cd68-4e8f-b5c8-2801ce3b1934 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:34 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c3d30-fc84-4c3e-a725-ccf6aa659f08]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:34 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 1073741824
Sep 11 23:08:34 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:35 devstack sudo[96783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD
Sep 11 23:08:35 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:35 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 is fetched for user 60ee67a563b54ef794c86cb714ee1d97. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[427cd441-bdab-49fe-be43-5f449c376d18]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:35 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:35 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 1073741824" returned: 0 in 0.716s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:35 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:35 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934
Sep 11 23:08:35 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-bd64fd47-27d5-4da8-b198-8ed46939b2a7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "cinder-bd64fd47-27d5-4da8-b198-8ed46939b2a7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Acquiring lock "cinder-quobyte-bd64fd47-27d5-4da8-b198-8ed46939b2a7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "cinder-quobyte-bd64fd47-27d5-4da8-b198-8ed46939b2a7" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff20a3-0183-4b3a-b154-a954c90f7cb1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:35 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:35 devstack sudo[96798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7
Sep 11 23:08:35 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:35 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-744702665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1c848d-665e-41d9-bb32-16db107a6806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109d9c55357d409a8f0b7461f544a386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:34Z,use_quota=True,user_id='60ee67a563b54ef794c86cb714ee1d97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Creating volume 8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:35 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcaba129-9ffa-4b7e-bcf9-cc29ba3f222a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea9a6a-1981-4120-a2d7-0bf1ed980a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:36 devstack sudo[96805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1073741824
Sep 11 23:08:36 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:36 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Volume volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 (5a56f251-cd68-4e8f-b5c8-2801ce3b1934): created successfully
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea9a6a-1981-4120-a2d7-0bf1ed980a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (7c7c41d4-1358-4a51-92c3-0efba4d88d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-65fd27f0-d825-4333-a51c-0b9117cf933c tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:36 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:36 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7
Sep 11 23:08:36 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:36 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1073741824" returned: 0 in 0.477s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:36 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bd64fd47-27d5-4da8-b198-8ed46939b2a7" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "cinder-quobyte-bd64fd47-27d5-4da8-b198-8ed46939b2a7" released by "delete_volume" :: held 0.704s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:36 devstack sudo[96816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806
Sep 11 23:08:36 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Created reservations ['647c30cd-238c-4fb2-8f37-fba1d30f4823', 'c9bbaaf3-0432-4523-bb87-5bef62eef060', '9c2098c3-44e6-4990-b1e1-9d6c477c5691', 'd274a455-330e-4784-b2bc-248ffb9aade3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:36 devstack sudo[96818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:36 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:36 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:36 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Attempting download of 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 8d1c848d-665e-41d9-bb32-16db107a6806. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:08:37 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.366s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Deleted volume successfully.
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab96906-8cdd-488b-a57b-b005583d20ed]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-713900cf-e3c7-4587-a137-0c2d2351c7e0 tempest-VolumesActionsTest-654433085 None] Lock "cinder-bd64fd47-27d5-4da8-b198-8ed46939b2a7-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-5a56f251-cd68-4e8f-b5c8-2801ce3b1934-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "cinder-5a56f251-cd68-4e8f-b5c8-2801ce3b1934-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:37 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie
Sep 11 23:08:37 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[843fda6f-a632-4900-ae66-4bdea944a25c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:37 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934
Sep 11 23:08:37 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:37 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie" returned: 0 in 0.393s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:37 devstack sudo[96828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie
Sep 11 23:08:37 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:37 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:37 devstack sudo[96833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934
Sep 11 23:08:37 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:37 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie" returned: 1 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_z4k2hzie' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d303c4b-49f4-4117-9ac0-ac53a7380ca7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:37 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-5a56f251-cd68-4e8f-b5c8-2801ce3b1934" released by "delete_volume" :: held 0.738s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:37 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD
Sep 11 23:08:37 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:37 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Created reservations ['bc25427a-a5bb-4a3b-850d-eddcb0d76a8c', '9be73427-8943-49b1-abc8-2a662533448a', '00e926cd-e5e3-43cf-bf6e-e7324f2ac641', '56d0f224-cfe6-43de-b381-63f7c5ac090a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:38 devstack sudo[96840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:38 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:38 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] 414d8567-5d24-440f-be04-3f648fa33a01 was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:38 devstack sudo[96845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806
Sep 11 23:08:38 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:38 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.292s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "cinder-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eb6e1953-24ee-4254-a27f-59f0d9943fb5 tempest-VolumesGetTest-435678142 None] Lock "cinder-5a56f251-cd68-4e8f-b5c8-2801ce3b1934-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb936ef9-493b-4c66-9d69-ca6c5e68ffcc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:38 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e
Sep 11 23:08:38 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:38 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" returned: 0 in 0.425s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:38 devstack sudo[96863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e
Sep 11 23:08:38 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:39 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e" released by "delete_volume" :: held 0.807s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Created reservations ['839fbb4f-f444-4398-962e-145ee2d7dc7c', '1cf6aeea-c2c8-4ca7-a68f-6d7ee2db52c8', '5432cb8a-25b0-4108-971d-2f8ef846ee7d', 'c8687531-4869-4a21-8d87-1c9a951a4726'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:39 devstack sudo[96866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:39 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "cinder-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (b805067c-4cb3-409b-b29f-9b8bc0fe5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a206530-18a6-410c-a45a-8b57b93f4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" acquired by "delete_volume" :: waited 0.093s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a206530-18a6-410c-a45a-8b57b93f4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-512068621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:40Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a47f86-187f-41af-a54d-a9f7e37c8680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a47f86-187f-41af-a54d-a9f7e37c8680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07fa7f4-4930-4cd8-b6cb-dab58e341c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07fa7f4-4930-4cd8-b6cb-dab58e341c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd452d19f-80a0-4b4e-b0cf-a663bf0a3a5b', 'volume_name': 'volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fc8081-0595-4d9c-903f-57c1f5d51a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:39 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fc8081-0595-4d9c-903f-57c1f5d51a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5324e4e-855e-4e89-91be-00bd5d3aa886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Volume d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b', 'volume_size': 1}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-512068621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:40Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Creating volume d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:40 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f788b3-cc98-40da-b235-4fcb10bc8d4f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.556s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:40 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b 1073741824
Sep 11 23:08:40 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f0a6593c-cce2-483c-ba22-dace8c9ee2b9 tempest-VolumesGetTest-435678142 None] Lock "cinder-253f8c1a-e14f-4731-84f7-bdf7e0a1f20e-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:40 devstack sudo[96870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:40 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:40 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806" returned: 0 in 2.210s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_27k55z7adevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:08:40 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Converted 112.00 MB image at 50.66 MB/s
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:40 devstack sudo[96881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1G
Sep 11 23:08:40 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:40 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:40 devstack sudo[96883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec
Sep 11 23:08:40 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:40 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b 1073741824" returned: 0 in 0.483s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=141,cinder:INSERT=34,cinder:SELECT=112,cinder:DELETE=15 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:40 devstack sudo[96885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b
Sep 11 23:08:40 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:40 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" returned: 0 in 0.346s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 1G" returned: 0 in 0.405s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Downloaded image 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 8d1c848d-665e-41d9-bb32-16db107a6806 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 for user 60ee67a563b54ef794c86cb714ee1d97 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Marking volume 8d1c848d-665e-41d9-bb32-16db107a6806 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec" released by "delete_volume" :: held 0.915s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Copying metadata from image 414d8567-5d24-440f-be04-3f648fa33a01 to 8d1c848d-665e-41d9-bb32-16db107a6806. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Creating volume glance metadata for volume 8d1c848d-665e-41d9-bb32-16db107a6806 backed by image 414d8567-5d24-440f-be04-3f648fa33a01 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=115,cinder:UPDATE=172,cinder:DELETE=12,cinder:INSERT=41 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Created reservations ['8078b610-2738-4bc2-87f8-3431e085601d', '69e329bb-d439-4737-9370-129b6d9633b5', '3184e6b9-4f20-472b-9759-513cbd539c38', '5ec647cf-6af4-4982-a6f0-0592fd2d2d6d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:40 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" returned: 0 in 0.415s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5324e4e-855e-4e89-91be-00bd5d3aa886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad95f5fe-4083-4290-8e62-380329c8e546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Volume volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b (d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b): created successfully
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad95f5fe-4083-4290-8e62-380329c8e546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (b805067c-4cb3-409b-b29f-9b8bc0fe5500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ea596c-d841-43ca-8ae7-b45cbecc63e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1c848d-665e-41d9-bb32-16db107a6806', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb647ac30>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf4be28-6644-4109-8d7f-ac9b734efeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-19937de6-ca2b-4c53-a3f6-802edf3a561a tempest-AttachVolumeNegativeTest-2066173202 None] Created volume successfully.
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Volume volume-8d1c848d-665e-41d9-bb32-16db107a6806 (8d1c848d-665e-41d9-bb32-16db107a6806): created successfully
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf4be28-6644-4109-8d7f-ac9b734efeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Flow 'volume_create_manager' (5ce46b0e-63ce-46b2-b56b-d46f5b4b9a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:41 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:41 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5e8769f7-16d3-4710-886f-54dc51dc0f23 tempest-VolumesImageMetadata-571905600 None] Created volume successfully.
Sep 11 23:08:41 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f62fc67a-370d-4a46-9162-78d5b8697ade tempest-VolumesGetTest-435678142 None] Lock "cinder-8b2a52bd-96ae-4617-b8c2-9448ccbe57ec-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Acquiring lock "cinder-8d1c848d-665e-41d9-bb32-16db107a6806-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "cinder-8d1c848d-665e-41d9-bb32-16db107a6806-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Acquiring lock "cinder-quobyte-8d1c848d-665e-41d9-bb32-16db107a6806" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "cinder-quobyte-8d1c848d-665e-41d9-bb32-16db107a6806" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da448b4-28df-4c35-aea0-b79b429a8612]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:42 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806
Sep 11 23:08:42 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:42 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806" returned: 0 in 0.560s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:42 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806
Sep 11 23:08:42 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-84e9fa8e-745b-4845-a855-bd8549ce3f3a req-ea3572a7-b544-4f75-a07c-9e378d896268 tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-84e9fa8e-745b-4845-a855-bd8549ce3f3a req-ea3572a7-b544-4f75-a07c-9e378d896268 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-84e9fa8e-745b-4845-a855-bd8549ce3f3a req-ea3572a7-b544-4f75-a07c-9e378d896268 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (9dd4ce18-8425-4608-b2f9-55a059ea7b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3032b674-9d45-4b40-89e9-7390227385a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3032b674-9d45-4b40-89e9-7390227385a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927191378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb50f1fe-c988-41eb-99d9-86dfd82777b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:43Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77f1ba1-dadc-470c-b309-363715997618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77f1ba1-dadc-470c-b309-363715997618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef79ce5-1c02-4dce-a9b2-6fb04da7693b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:42 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-84e9fa8e-745b-4845-a855-bd8549ce3f3a req-ea3572a7-b544-4f75-a07c-9e378d896268 tempest-AttachVolumeNegativeTest-2066173202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1836b7e-9c12-43ba-a6b7-5ac6a2fe4caa', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:08:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-84e9fa8e-745b-4845-a855-bd8549ce3f3a req-ea3572a7-b544-4f75-a07c-9e378d896268 tempest-AttachVolumeNegativeTest-2066173202 None] attachment_update completed successfully.
Sep 11 23:08:43 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8d1c848d-665e-41d9-bb32-16db107a6806" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "cinder-quobyte-8d1c848d-665e-41d9-bb32-16db107a6806" released by "delete_volume" :: held 0.941s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Created reservations ['0f2f7289-8456-4d8d-a031-72731a785ad0', '1784e052-33fb-4a5a-b748-981ae58c5b11', 'effef464-6e97-43ad-8219-6f8078946c3a', '433be4a9-73d6-4cf6-9571-2b3ba398be3f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef79ce5-1c02-4dce-a9b2-6fb04da7693b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb50f1fe-c988-41eb-99d9-86dfd82777b7', 'volume_name': 'volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb663d550>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38652b4a-72a0-4cbf-b8ae-bbaf630e4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38652b4a-72a0-4cbf-b8ae-bbaf630e4472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50327567-e842-46d4-9d08-f4ea7aade48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Volume bb50f1fe-c988-41eb-99d9-86dfd82777b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb663d550>}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Trying to clone bb50f1fe-c988-41eb-99d9-86dfd82777b7 from image 414d8567-5d24-440f-be04-3f648fa33a01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:43 devstack sudo[96984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:43 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:43 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Deleted volume successfully.
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:08:43 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b040301-4076-487b-ad61-7ab023ac563c tempest-VolumesImageMetadata-571905600 None] Lock "cinder-8d1c848d-665e-41d9-bb32-16db107a6806-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199cb44-15f6-4c6e-8f9c-34eccc763950]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:44 devstack sudo[97303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD
Sep 11 23:08:44 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:44 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 is fetched for user a4be58fd7acc45da81a68265d7029a98. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[62949bb4-56d1-4b53-b5b3-4f2d4eb98565]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:44 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD
Sep 11 23:08:44 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:44 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-927191378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb50f1fe-c988-41eb-99d9-86dfd82777b7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:43Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Creating volume bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:44 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:44 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1073741824
Sep 11 23:08:44 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:45 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1073741824" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:45 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7
Sep 11 23:08:45 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-f591deae-4056-47b4-95e0-5f632bfe9b7a req-a1dbbef1-d251-4e5d-bba4-cd585d4348f2 tempest-AttachVolumeNegativeTest-2066173202 None] Terminate volume connection completed successfully.
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-f591deae-4056-47b4-95e0-5f632bfe9b7a req-a1dbbef1-d251-4e5d-bba4-cd585d4348f2 tempest-AttachVolumeNegativeTest-2066173202 None] Deleting attachment a1836b7e-9c12-43ba-a6b7-5ac6a2fe4caa. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:08:45 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7" returned: 0 in 0.341s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Attempting download of 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume bb50f1fe-c988-41eb-99d9-86dfd82777b7. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb43b1-29f7-49cb-9af9-7bced7029b32]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:46 devstack sudo[97352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:46 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:46 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2
Sep 11 23:08:46 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:46 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2" returned: 0 in 0.439s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:46 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.395s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:08:46 devstack sudo[97358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2
Sep 11 23:08:46 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:46 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2" returned: 1 in 0.493s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_6nbcgvy2' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[61736869-9b44-4276-8eb8-50232672a3ba]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:47 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD
Sep 11 23:08:47 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:47 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:47 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] 414d8567-5d24-440f-be04-3f648fa33a01 was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:08:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:47 devstack sudo[97386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7
Sep 11 23:08:47 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:50 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7" returned: 0 in 2.752s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_y189is7kdevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:08:50 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Converted 112.00 MB image at 40.68 MB/s
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:50 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1G
Sep 11 23:08:50 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:50 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 1G" returned: 0 in 0.471s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Downloaded image 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume bb50f1fe-c988-41eb-99d9-86dfd82777b7 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 for user a4be58fd7acc45da81a68265d7029a98 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Marking volume bb50f1fe-c988-41eb-99d9-86dfd82777b7 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Copying metadata from image 414d8567-5d24-440f-be04-3f648fa33a01 to bb50f1fe-c988-41eb-99d9-86dfd82777b7. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Creating volume glance metadata for volume bb50f1fe-c988-41eb-99d9-86dfd82777b7 backed by image 414d8567-5d24-440f-be04-3f648fa33a01 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50327567-e842-46d4-9d08-f4ea7aade48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb663d550>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec420ff-b551-490c-99b7-8601b6c79771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Volume volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 (bb50f1fe-c988-41eb-99d9-86dfd82777b7): created successfully
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec420ff-b551-490c-99b7-8601b6c79771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (9dd4ce18-8425-4608-b2f9-55a059ea7b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a7152f89-a01e-4b6b-8223-7a393a1a7da7 tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (cbed36cf-82bd-44d1-a29f-d3d973ea4105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed8a9c8-ba1f-4932-8790-12a99f5e8c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed8a9c8-ba1f-4932-8790-12a99f5e8c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-265354308',display_name='tempest-VolumesGetTest-Volume-248055388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a795c5e-e020-416c-b59f-2a7a61a5f80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:53Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd99533-f8db-436e-b458-dd2bed638205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd99533-f8db-436e-b458-dd2bed638205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389b672c-bae0-45b0-b6fe-b3a615843975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (389b672c-bae0-45b0-b6fe-b3a615843975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a795c5e-e020-416c-b59f-2a7a61a5f80a', 'volume_name': 'volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82124220-58a3-44e1-8e18-df52a1879ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82124220-58a3-44e1-8e18-df52a1879ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4dbb2cb-5508-43c9-9612-db387e2f7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:52 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Volume 3a795c5e-e020-416c-b59f-2a7a61a5f80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a', 'volume_size': 1}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-265354308',display_name='tempest-VolumesGetTest-Volume-248055388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a795c5e-e020-416c-b59f-2a7a61a5f80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94badb85a03f4c67ae25ad1518797a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:53Z,use_quota=True,user_id='a4be58fd7acc45da81a68265d7029a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Creating volume 3a795c5e-e020-416c-b59f-2a7a61a5f80a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:52 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:52 devstack sudo[97410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a 1073741824
Sep 11 23:08:52 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:53 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a 1073741824" returned: 0 in 0.702s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:53 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a
Sep 11 23:08:53 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:54 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a" returned: 0 in 0.366s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4dbb2cb-5508-43c9-9612-db387e2f7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b90ad1-5290-4757-9851-27f3d66d4771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:54 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Volume volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a (3a795c5e-e020-416c-b59f-2a7a61a5f80a): created successfully
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b90ad1-5290-4757-9851-27f3d66d4771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Flow 'volume_create_manager' (cbed36cf-82bd-44d1-a29f-d3d973ea4105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-62cdb56a-59a0-4799-80e5-c161ec5c3803 tempest-VolumesGetTest-435678142 None] Created volume successfully.
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-3a795c5e-e020-416c-b59f-2a7a61a5f80a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "cinder-3a795c5e-e020-416c-b59f-2a7a61a5f80a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-3a795c5e-e020-416c-b59f-2a7a61a5f80a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-3a795c5e-e020-416c-b59f-2a7a61a5f80a" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcfd312-aed7-4c22-9d5d-c07b6346fc4f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:55 devstack sudo[97421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a
Sep 11 23:08:55 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:55 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a" returned: 0 in 0.483s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:55 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a
Sep 11 23:08:55 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:55 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Flow 'volume_create_manager' (e432097f-d850-4439-958b-f0266b798d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2eedd-5f5a-4c6d-8313-b0158eaa80a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3a795c5e-e020-416c-b59f-2a7a61a5f80a" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c2eedd-5f5a-4c6d-8313-b0158eaa80a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2035460166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c44fa-5022-4ecf-87fe-49b6eed29d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0266d5df61c64c7cbb3dc8a8bec3679a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:56Z,use_quota=True,user_id='ff8e20fab9d04d7789ce9f5aac645c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553ab5c-37ae-401b-a5fb-22093911ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553ab5c-37ae-401b-a5fb-22093911ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbea2c91-375a-4f47-bc82-bd372d98cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbea2c91-375a-4f47-bc82-bd372d98cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63c44fa-5022-4ecf-87fe-49b6eed29d46', 'volume_name': 'volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc067dda-8b1f-42a0-aeac-0a1fd4b29ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc067dda-8b1f-42a0-aeac-0a1fd4b29ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b9806a-8062-4e20-9ab6-df345dc3f1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:55 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Volume f63c44fa-5022-4ecf-87fe-49b6eed29d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46', 'volume_size': 1}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2035460166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63c44fa-5022-4ecf-87fe-49b6eed29d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0266d5df61c64c7cbb3dc8a8bec3679a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:56Z,use_quota=True,user_id='ff8e20fab9d04d7789ce9f5aac645c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Creating volume f63c44fa-5022-4ecf-87fe-49b6eed29d46 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:55 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-3a795c5e-e020-416c-b59f-2a7a61a5f80a" released by "delete_volume" :: held 0.983s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:55 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 1073741824
Sep 11 23:08:55 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:55 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Created reservations ['8f5f5dcc-d12f-418b-aa74-23e0afca6b44', '817243be-856d-4c90-aa90-ffd8d620b041', '34914378-ddca-4163-b6a8-54b534908935', '5d60503c-4b51-448d-99b8-d22d82a9a552'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:56 devstack sudo[97433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:56 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:56 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:56 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 1073741824" returned: 0 in 0.591s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (6826d22e-552e-4971-8b45-c9ba18d2248d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da533589-f208-4943-92dc-4c522f3f8bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24dd167c-fe0f-49e3-9683-c286677f3973 tempest-VolumesGetTest-435678142 None] Lock "cinder-3a795c5e-e020-416c-b59f-2a7a61a5f80a-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da533589-f208-4943-92dc-4c522f3f8bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909189228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa3691a-db23-445c-b956-de7cf7984204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:56Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc397ccb-e6ab-4bd5-8a55-711d811171c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc397ccb-e6ab-4bd5-8a55-711d811171c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c485c00-b489-4fe7-8d56-2db4c7b8db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c485c00-b489-4fe7-8d56-2db4c7b8db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aa3691a-db23-445c-b956-de7cf7984204', 'volume_name': 'volume-5aa3691a-db23-445c-b956-de7cf7984204', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff67d567-1add-4a4f-911d-273b773c530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff67d567-1add-4a4f-911d-273b773c530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc35a7-8d50-472e-b0ef-8075e5b5139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Volume 5aa3691a-db23-445c-b956-de7cf7984204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aa3691a-db23-445c-b956-de7cf7984204', 'volume_size': 1}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:56 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46
Sep 11 23:08:56 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:56 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46" returned: 0 in 0.248s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.268s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1909189228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aa3691a-db23-445c-b956-de7cf7984204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:56Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Creating volume 5aa3691a-db23-445c-b956-de7cf7984204 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:56 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b9806a-8062-4e20-9ab6-df345dc3f1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 1073741824
Sep 11 23:08:56 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da128d-5255-421f-9536-b34e64d28330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:56 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Volume volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 (f63c44fa-5022-4ecf-87fe-49b6eed29d46): created successfully
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25da128d-5255-421f-9536-b34e64d28330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Flow 'volume_create_manager' (e432097f-d850-4439-958b-f0266b798d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-25de3d84-744f-4769-8e7e-4c06beb135e4 tempest-AbsoluteLimitsTests-1521360157 None] Created volume successfully.
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-bb50f1fe-c988-41eb-99d9-86dfd82777b7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "cinder-bb50f1fe-c988-41eb-99d9-86dfd82777b7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Acquiring lock "cinder-quobyte-bb50f1fe-c988-41eb-99d9-86dfd82777b7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-bb50f1fe-c988-41eb-99d9-86dfd82777b7" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa626053-f556-457f-bba8-869bb36e9d73]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:57 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:57 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7
Sep 11 23:08:57 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 1073741824" returned: 0 in 0.586s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:57 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204
Sep 11 23:08:57 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:57 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7" returned: 0 in 0.447s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:57 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204" returned: 0 in 0.303s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:57 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7
Sep 11 23:08:57 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2dc35a7-8d50-472e-b0ef-8075e5b5139d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aa3691a-db23-445c-b956-de7cf7984204', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3d4c41-64e4-40da-a293-f3ad3a8b4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:57 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Volume volume-5aa3691a-db23-445c-b956-de7cf7984204 (5aa3691a-db23-445c-b956-de7cf7984204): created successfully
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3d4c41-64e4-40da-a293-f3ad3a8b4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (6826d22e-552e-4971-8b45-c9ba18d2248d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1932e444-7a54-4d65-ac87-6c949495e0ba tempest-VolumesListAdminTestJSON-1928720929 None] Created volume successfully.
Sep 11 23:08:58 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb50f1fe-c988-41eb-99d9-86dfd82777b7" returned: 0 in 0.347s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "cinder-quobyte-bb50f1fe-c988-41eb-99d9-86dfd82777b7" released by "delete_volume" :: held 0.852s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Created reservations ['58c806be-9888-4973-9079-213e4e407f99', '7993e05a-1fdb-4a30-81db-408909ae246d', '06817a1c-efcb-4baa-b728-3ab6058ab9b8', '22dbcc26-5766-4f43-88ba-961e0d218be4'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Acquiring lock "cinder-f63c44fa-5022-4ecf-87fe-49b6eed29d46-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "cinder-f63c44fa-5022-4ecf-87fe-49b6eed29d46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Acquiring lock "cinder-quobyte-f63c44fa-5022-4ecf-87fe-49b6eed29d46" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "cinder-quobyte-f63c44fa-5022-4ecf-87fe-49b6eed29d46" acquired by "delete_volume" :: waited 0.072s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:08:58 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:58 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[929c3db7-a5d1-4ab9-9c70-d089aa333124]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:58 devstack sudo[97465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46
Sep 11 23:08:58 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:58 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.405s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:08:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Deleted volume successfully.
Sep 11 23:08:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e134449e-48fc-4498-8dce-ee633f1b393f tempest-VolumesGetTest-435678142 None] Lock "cinder-bb50f1fe-c988-41eb-99d9-86dfd82777b7-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:59 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46" returned: 0 in 0.678s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:59 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46
Sep 11 23:08:59 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (35893c7d-192e-4545-ab3a-b9d8d1eb5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65299ad6-69af-4287-8e67-e3fbe020e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65299ad6-69af-4287-8e67-e3fbe020e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642144169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dd44b9-b22d-4906-ac88-b15f4afa873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:59Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b008ee-40be-4aef-85e2-819039e9a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:59 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b008ee-40be-4aef-85e2-819039e9a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614636d0-4690-4b3a-82a6-efbd26f3dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614636d0-4690-4b3a-82a6-efbd26f3dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59dd44b9-b22d-4906-ac88-b15f4afa873e', 'volume_name': 'volume-59dd44b9-b22d-4906-ac88-b15f4afa873e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae07b59-6e30-4922-b249-0d6042935e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae07b59-6e30-4922-b249-0d6042935e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2d8818-f81e-43d1-87f4-d6dc4dfef078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:08:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Volume 59dd44b9-b22d-4906-ac88-b15f4afa873e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59dd44b9-b22d-4906-ac88-b15f4afa873e', 'volume_size': 1}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1642144169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59dd44b9-b22d-4906-ac88-b15f4afa873e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:08:59Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Creating volume 59dd44b9-b22d-4906-ac88-b15f4afa873e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:08:59 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f63c44fa-5022-4ecf-87fe-49b6eed29d46" returned: 0 in 0.541s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "cinder-quobyte-f63c44fa-5022-4ecf-87fe-49b6eed29d46" released by "delete_volume" :: held 1.323s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:08:59 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e 1073741824
Sep 11 23:08:59 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Created reservations ['8b4079cc-7f73-4acb-a8a2-4cc85783ee2d', 'f6aa7570-c08d-44f1-8424-ea73b43ad040', '252f64d2-3cd8-46f7-a89f-742fd6788df8', '231c1900-b8ae-4d1d-95e1-9d5302f7802a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:08:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:08:59 devstack sudo[97489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:08:59 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:00 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Deleted volume successfully.
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b7c238f2-0466-438e-967a-93f52f0d5c32 tempest-AbsoluteLimitsTests-1521360157 None] Lock "cinder-f63c44fa-5022-4ecf-87fe-49b6eed29d46-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:00 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e 1073741824" returned: 0 in 0.747s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:00 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e
Sep 11 23:09:00 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:00 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2d8818-f81e-43d1-87f4-d6dc4dfef078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59dd44b9-b22d-4906-ac88-b15f4afa873e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72080ed2-a0e4-4e27-8952-f28947723f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Volume volume-59dd44b9-b22d-4906-ac88-b15f4afa873e (59dd44b9-b22d-4906-ac88-b15f4afa873e): created successfully
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72080ed2-a0e4-4e27-8952-f28947723f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (35893c7d-192e-4545-ab3a-b9d8d1eb5d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b682f167-ae54-49d7-8507-18c3c83981b6 tempest-VolumesListAdminTestJSON-1928720929 None] Created volume successfully.
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (f3399d21-2e32-4f9b-bac2-a3bb8e9f7af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8b1f69-5f6f-4e83-8478-9ea20053aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8b1f69-5f6f-4e83-8478-9ea20053aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1209299040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db782a2b-903c-43bb-8e7b-04ef2491b939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:02Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69b3d65-c1f4-4cfd-ab39-3a95245f882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69b3d65-c1f4-4cfd-ab39-3a95245f882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a8be94-769e-4a23-953a-2981e6f072df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a8be94-769e-4a23-953a-2981e6f072df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db782a2b-903c-43bb-8e7b-04ef2491b939', 'volume_name': 'volume-db782a2b-903c-43bb-8e7b-04ef2491b939', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3e71cb-ad93-4977-8c3b-bb4d554f4d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3e71cb-ad93-4977-8c3b-bb4d554f4d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b92e61-79cf-4599-8901-bbb95c2aa195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:02 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Volume db782a2b-903c-43bb-8e7b-04ef2491b939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db782a2b-903c-43bb-8e7b-04ef2491b939', 'volume_size': 1}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1209299040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db782a2b-903c-43bb-8e7b-04ef2491b939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170a76b9c8494d4f9c4d3f0660386f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:02Z,use_quota=True,user_id='9a9ab05690c8461f80cc0dc1fce89c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Creating volume db782a2b-903c-43bb-8e7b-04ef2491b939 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:02 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:02 devstack sudo[97524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 1073741824
Sep 11 23:09:02 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:03 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 1073741824" returned: 0 in 1.087s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:03 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939
Sep 11 23:09:03 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:04 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939" returned: 0 in 0.450s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0b92e61-79cf-4599-8901-bbb95c2aa195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db782a2b-903c-43bb-8e7b-04ef2491b939', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6b3269-e5ff-4537-83ba-dc5dcb600612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:04 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Volume volume-db782a2b-903c-43bb-8e7b-04ef2491b939 (db782a2b-903c-43bb-8e7b-04ef2491b939): created successfully
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6b3269-e5ff-4537-83ba-dc5dcb600612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Flow 'volume_create_manager' (f3399d21-2e32-4f9b-bac2-a3bb8e9f7af1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d3a051a8-febb-480b-879a-f95181c44006 tempest-VolumesListAdminTestJSON-1928720929 None] Created volume successfully.
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Flow 'volume_create_manager' (bba36819-ca43-4d4b-b19c-4a784680aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b618bff5-7705-4df2-b2b0-03c892d7e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b618bff5-7705-4df2-b2b0-03c892d7e401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6600c10a-90bb-4237-b37a-eaeffc3cb562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac37afa6f7044aaf8e9162c75d1c39b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:07Z,use_quota=True,user_id='75256574c83843449834d604dd59c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d6612c-ac91-4661-bc1d-7551190d976b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d6612c-ac91-4661-bc1d-7551190d976b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d7f73-dbcc-49dd-b383-d60f03e88dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799d7f73-dbcc-49dd-b383-d60f03e88dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6600c10a-90bb-4237-b37a-eaeffc3cb562', 'volume_name': 'volume-6600c10a-90bb-4237-b37a-eaeffc3cb562', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd0ad27-24a1-46d9-8395-0f82228ea25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd0ad27-24a1-46d9-8395-0f82228ea25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca7fcfb-aa6f-41ed-9486-7b8c16fc21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Volume 6600c10a-90bb-4237-b37a-eaeffc3cb562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6600c10a-90bb-4237-b37a-eaeffc3cb562', 'volume_size': 1}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6600c10a-90bb-4237-b37a-eaeffc3cb562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac37afa6f7044aaf8e9162c75d1c39b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:07Z,use_quota=True,user_id='75256574c83843449834d604dd59c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Creating volume 6600c10a-90bb-4237-b37a-eaeffc3cb562 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:07 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 1073741824
Sep 11 23:09:07 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:08 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 1073741824" returned: 0 in 0.761s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:08 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562
Sep 11 23:09:08 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:08 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562" returned: 0 in 0.551s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca7fcfb-aa6f-41ed-9486-7b8c16fc21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6600c10a-90bb-4237-b37a-eaeffc3cb562', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cd9c3f-a42c-4991-992b-d0778fa2b00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Volume volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 (6600c10a-90bb-4237-b37a-eaeffc3cb562): created successfully
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cd9c3f-a42c-4991-992b-d0778fa2b00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Flow 'volume_create_manager' (bba36819-ca43-4d4b-b19c-4a784680aee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3608b208-7b70-43ea-a379-0f4851b69e4c tempest-VolumesListAdminTestJSON-505684996 None] Created volume successfully.
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Acquiring lock "cinder-6600c10a-90bb-4237-b37a-eaeffc3cb562-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "cinder-6600c10a-90bb-4237-b37a-eaeffc3cb562-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Acquiring lock "cinder-quobyte-6600c10a-90bb-4237-b37a-eaeffc3cb562" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "cinder-quobyte-6600c10a-90bb-4237-b37a-eaeffc3cb562" acquired by "delete_volume" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c57db83-4294-48e8-993e-24df7e59e68f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-db782a2b-903c-43bb-8e7b-04ef2491b939-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-db782a2b-903c-43bb-8e7b-04ef2491b939-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-quobyte-db782a2b-903c-43bb-8e7b-04ef2491b939" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-db782a2b-903c-43bb-8e7b-04ef2491b939" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:10 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562
Sep 11 23:09:10 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc552c10-b726-4916-b5c4-9300748f9a6d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:10 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939
Sep 11 23:09:10 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Flow 'volume_create_manager' (f0031d65-d285-4563-a68d-0d9c71e4b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:10 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4c521b-c7eb-4460-a022-eeb555d39bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562" returned: 0 in 0.632s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4c521b-c7eb-4460-a022-eeb555d39bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1097352315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb72b1c-7fdf-4063-8491-3c002c3cbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871e583c87ba47b1ae0ec7eb9b1c528c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:10Z,use_quota=True,user_id='164d5a54328243019382b083fe16630c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e3e0f6-a9e8-4e3f-847e-34f142dfafc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:10 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e3e0f6-a9e8-4e3f-847e-34f142dfafc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:10 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ad9c6-2bd6-4fba-87a4-d4e6e103f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5ad9c6-2bd6-4fba-87a4-d4e6e103f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'volume_name': 'volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcec45-54ff-4d00-b447-493498f92260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcec45-54ff-4d00-b447-493498f92260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c10e2a0-ea79-4d8c-9029-8e77101ecd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Volume cdb72b1c-7fdf-4063-8491-3c002c3cbabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'volume_size': 1}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1097352315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb72b1c-7fdf-4063-8491-3c002c3cbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871e583c87ba47b1ae0ec7eb9b1c528c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:10Z,use_quota=True,user_id='164d5a54328243019382b083fe16630c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Creating volume cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:10 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe 1073741824
Sep 11 23:09:10 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:10 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939" returned: 0 in 0.712s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:10 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939
Sep 11 23:09:10 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:10 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6600c10a-90bb-4237-b37a-eaeffc3cb562" returned: 0 in 0.494s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "cinder-quobyte-6600c10a-90bb-4237-b37a-eaeffc3cb562" released by "delete_volume" :: held 1.211s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Created reservations ['cef02961-7057-4461-8050-f3502bbb10c8', 'e826da52-d0b2-4bb2-b85f-476a2dc3b682', 'a7ebd988-b175-4b4c-8647-c991a73cb59f', '488d0fdd-980a-41bf-803e-aa5f7062a601'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:11 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-db782a2b-903c-43bb-8e7b-04ef2491b939" returned: 0 in 0.483s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:11 devstack sudo[97648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:11 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-db782a2b-903c-43bb-8e7b-04ef2491b939" released by "delete_volume" :: held 1.288s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Flow 'volume_create_manager' (1af70465-edef-4f70-98fc-f810cbbd0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f933812-7bf3-4ea6-9a94-05e4cbd690a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f933812-7bf3-4ea6-9a94-05e4cbd690a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-767426470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cae6285-3658-468a-918a-cf364707622c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330601635e724e20802196ba9c6f653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:11Z,use_quota=True,user_id='3c9de4d0270b4043b2664515386c7a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51e9ceb-2549-4d20-8a3d-0f615224ef0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51e9ceb-2549-4d20-8a3d-0f615224ef0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0dd78c-840e-4cce-9d68-b3cee8ec707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0dd78c-840e-4cce-9d68-b3cee8ec707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cae6285-3658-468a-918a-cf364707622c', 'volume_name': 'volume-1cae6285-3658-468a-918a-cf364707622c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cbae8b-9a0b-4f09-9724-8c402b136260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6cbae8b-9a0b-4f09-9724-8c402b136260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08827a1d-e866-40c8-b202-0035fbea884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Volume 1cae6285-3658-468a-918a-cf364707622c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cae6285-3658-468a-918a-cf364707622c', 'volume_size': 1}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe 1073741824" returned: 0 in 0.882s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Created reservations ['875cc480-3973-4cd7-b16d-8f4ab02df38b', 'd35a0262-38ed-474c-a905-bc44aac00fed', 'ef2754ab-4616-4a78-9cc8-bc22c31b94d4', '7d4d4848-ca86-4e75-a810-c80e9d63d9a3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:11 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:11 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:11 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.320s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Deleted volume successfully.
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9f92d7c1-9f12-4a88-9668-f083abdb49c1 tempest-VolumesListAdminTestJSON-505684996 None] Lock "cinder-6600c10a-90bb-4237-b37a-eaeffc3cb562-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:11 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:11 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:11 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.334s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-767426470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cae6285-3658-468a-918a-cf364707622c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330601635e724e20802196ba9c6f653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:11Z,use_quota=True,user_id='3c9de4d0270b4043b2664515386c7a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Creating volume 1cae6285-3658-468a-918a-cf364707622c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:11 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c 1073741824
Sep 11 23:09:11 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c10e2a0-ea79-4d8c-9029-8e77101ecd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddc66a-1e46-4349-969f-2ca4f50b0572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Volume volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe (cdb72b1c-7fdf-4063-8491-3c002c3cbabe): created successfully
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddc66a-1e46-4349-969f-2ca4f50b0572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Flow 'volume_create_manager' (f0031d65-d285-4563-a68d-0d9c71e4b167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cb53d4cc-581a-4447-9af3-9b967bee59d5 tempest-VolumesCloneTest-1051619076 None] Created volume successfully.
Sep 11 23:09:11 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.303s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Deleted volume successfully.
Sep 11 23:09:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5654d5ab-dd72-4e46-b3bc-a957d59d046b tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-db782a2b-903c-43bb-8e7b-04ef2491b939-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:12 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c 1073741824" returned: 0 in 0.514s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-59dd44b9-b22d-4906-ac88-b15f4afa873e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-59dd44b9-b22d-4906-ac88-b15f4afa873e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:12 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c
Sep 11 23:09:12 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-quobyte-59dd44b9-b22d-4906-ac88-b15f4afa873e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-59dd44b9-b22d-4906-ac88-b15f4afa873e" acquired by "delete_volume" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7fb282-500c-4d41-821e-ff281d99985e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:12 devstack sudo[97665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e
Sep 11 23:09:12 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:12 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c" returned: 0 in 0.363s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08827a1d-e866-40c8-b202-0035fbea884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cae6285-3658-468a-918a-cf364707622c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8274802e-bbd1-4a49-849a-87b5c2aae976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:12 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Volume volume-1cae6285-3658-468a-918a-cf364707622c (1cae6285-3658-468a-918a-cf364707622c): created successfully
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8274802e-bbd1-4a49-849a-87b5c2aae976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Flow 'volume_create_manager' (1af70465-edef-4f70-98fc-f810cbbd0da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e0ff5cb9-fd0a-4aa3-ac6c-24157f9644c6 tempest-VolumesNegativeTest-1070043637 None] Created volume successfully.
Sep 11 23:09:13 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:13 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e
Sep 11 23:09:13 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Flow 'volume_create_manager' (89c40cc2-df01-4032-bb94-e7cc8e10a110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca2838f-725b-4408-a796-e20c15c145b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca2838f-725b-4408-a796-e20c15c145b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1310778943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='871e583c87ba47b1ae0ec7eb9b1c528c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=cdb72b1c-7fdf-4063-8491-3c002c3cbabe,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:13Z,use_quota=True,user_id='164d5a54328243019382b083fe16630c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bdb21d-700a-435c-97a8-89f1747fc63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75bdb21d-700a-435c-97a8-89f1747fc63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1a7f5d-889e-4bf3-a9ef-b683514cf53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1a7f5d-889e-4bf3-a9ef-b683514cf53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8', 'volume_name': 'volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8', 'volume_size': 2, 'source_volid': 'cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'source_volstatus': 'available'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de7b528-f542-4164-b540-f3a5e6d36835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de7b528-f542-4164-b540-f3a5e6d36835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd5af5-0364-4d0d-ae9a-42cac27edfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Volume 8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8', 'volume_size': 2, 'source_volid': 'cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'source_volstatus': 'available'}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:13 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Cloning volume cdb72b1c-7fdf-4063-8491-3c002c3cbabe to volume 8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8
Sep 11 23:09:13 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-59dd44b9-b22d-4906-ac88-b15f4afa873e" returned: 0 in 0.338s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-59dd44b9-b22d-4906-ac88-b15f4afa873e" released by "delete_volume" :: held 0.892s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Creating offline snapshot 07999358-3516-4654-b911-e5923fe0fb11 of volume cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9638e-87f0-438c-99f9-711835f3ee53]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Created reservations ['98c6e7bb-d29c-47fd-83b3-d73c82b5faae', '6fc0e8d6-4e0e-422b-ab9a-6673a8a60c70', '8441d516-ed7c-4c18-9167-cd9e1161b7e3', '1ff2a562-82e0-42a3-8787-c95594949798'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:13 devstack sudo[97676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:13 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:13 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:13 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-5aa3691a-db23-445c-b956-de7cf7984204-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-5aa3691a-db23-445c-b956-de7cf7984204-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "cinder-quobyte-5aa3691a-db23-445c-b956-de7cf7984204" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-5aa3691a-db23-445c-b956-de7cf7984204" acquired by "delete_volume" :: waited 0.049s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:14 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.539s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[10123e04-b529-4ecf-b7d4-0fd6720d8a43]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Deleted volume successfully.
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-276a2ca6-5cdf-420b-8fe0-efbf710b4fa3 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-59dd44b9-b22d-4906-ac88-b15f4afa873e-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:14 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.871s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:14 devstack sudo[97680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204
Sep 11 23:09:14 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:14 devstack sudo[97684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 1G
Sep 11 23:09:14 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:14 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204" returned: 0 in 0.621s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:14 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204
Sep 11 23:09:14 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:14 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 1G" returned: 0 in 0.651s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:14 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:14 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:15 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5aa3691a-db23-445c-b956-de7cf7984204" returned: 0 in 0.363s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-quobyte-5aa3691a-db23-445c-b956-de7cf7984204" released by "delete_volume" :: held 1.061s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Created reservations ['92a51dce-b9ee-4c89-87e2-e1afe93a5b46', '7d20ec93-bca9-4668-8482-6c5fa0fb754e', '947fc82a-d15a-4562-a1b4-3c24e1cb0673', '7ad734e6-e378-4a0c-93e9-69362cedf461'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:15 devstack sudo[97707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:15 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:15 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.534s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:15 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 is being set with open permissions: ugo+rw
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:15 devstack sudo[97709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:15 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:15 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.373s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Deleted volume successfully.
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2d7e79b-c676-40d3-a1cf-f8ea4a933276 tempest-VolumesListAdminTestJSON-1928720929 None] Lock "cinder-5aa3691a-db23-445c-b956-de7cf7984204-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:15 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:15 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info
Sep 11 23:09:15 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:16 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:16 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info is being set with open permissions: ugo+rw
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:16 devstack sudo[97716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info
Sep 11 23:09:16 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:16 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.info" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] snapshot: 07999358-3516-4654-b911-e5923fe0fb11, volume: 8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[05af6321-2b34-4557-abba-9027400896ac]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:17 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:17 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:17 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.594s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122e78e-c148-48f6-abd8-bfa9d6d6d4a3]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:17 devstack sudo[97755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:17 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:17 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.428s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:09:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:17 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8
Sep 11 23:09:17 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:23 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" returned: 0 in 5.958s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:23 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:09:23 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Converted 1024.00 MB image at 171.80 MB/s
Sep 11 23:09:23 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 is being set with open permissions: ugo+rw
Sep 11 23:09:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:23 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8
Sep 11 23:09:23 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:24 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" returned: 0 in 0.579s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" released by "_copy_volume_from_snapshot" :: held 7.677s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-quobyte-07999358-3516-4654-b911-e5923fe0fb11" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-07999358-3516-4654-b911-e5923fe0fb11" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Deleting offline snapshot 07999358-3516-4654-b911-e5923fe0fb11 of volume cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] snapshot_file for this snap is: volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[221782e6-e080-4c64-806c-c41c0b0c713b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:24 devstack sudo[97853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:24 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:25 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.738s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:09:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94836d-36f0-4f4c-bc15-cae916429b27]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:25 devstack sudo[97861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:25 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:25 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=104,cinder:SELECT=76,cinder:INSERT=31,cinder:DELETE=12 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:09:26 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.967s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:26 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:26 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:26 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.498s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:26 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11
Sep 11 23:09:26 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:27 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe.07999358-3516-4654-b911-e5923fe0fb11" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-07999358-3516-4654-b911-e5923fe0fb11" released by "_delete_snapshot" :: held 2.760s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.961s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4bd5af5-0364-4d0d-ae9a-42cac27edfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8', 'volume_size': 2, 'source_volid': 'cdb72b1c-7fdf-4063-8491-3c002c3cbabe', 'source_volstatus': 'available'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b8de66-936a-42be-9405-beef9df86d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Volume volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 (8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8): created successfully
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b8de66-936a-42be-9405-beef9df86d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Flow 'volume_create_manager' (89c40cc2-df01-4032-bb94-e7cc8e10a110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6393f0bc-3f74-4732-bff4-16408646cfcd tempest-VolumesCloneTest-1051619076 None] Created volume successfully.
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "cinder-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7800b74a-713c-41c6-81ea-dcf348fc14bd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (8db753fc-fd35-4190-98b8-dbe4f5ccf84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8014b6-b704-42d3-a6ef-58289c63559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed8014b6-b704-42d3-a6ef-58289c63559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-961781285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de002683-bfbd-4b32-8af5-1e49f468a29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:28Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffda6c-3d1f-4a34-be0a-490a5d37c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ffda6c-3d1f-4a34-be0a-490a5d37c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899aab80-079e-4339-87e4-2ec4a0a28ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899aab80-079e-4339-87e4-2ec4a0a28ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de002683-bfbd-4b32-8af5-1e49f468a29d', 'volume_name': 'volume-de002683-bfbd-4b32-8af5-1e49f468a29d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a51f472-6332-40c6-b32d-95cb3b69975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a51f472-6332-40c6-b32d-95cb3b69975c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c3136-a48a-4ba0-9138-7eac031d342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Volume de002683-bfbd-4b32-8af5-1e49f468a29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de002683-bfbd-4b32-8af5-1e49f468a29d', 'volume_size': 1}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-961781285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de002683-bfbd-4b32-8af5-1e49f468a29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbcb9b375f9a4bab93a87237298c4ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:28Z,use_quota=True,user_id='7696326805cd49139a7411556bfb343f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Creating volume de002683-bfbd-4b32-8af5-1e49f468a29d {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:28 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:28 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8
Sep 11 23:09:28 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:28 devstack sudo[97900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d 1073741824
Sep 11 23:09:28 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:28 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" returned: 0 in 0.457s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:28 devstack sudo[97908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8
Sep 11 23:09:28 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Flow 'volume_create_manager' (768761f8-ce4e-4cef-a247-af31f7904905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea43e07-5695-4cca-a945-263d7db0c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea43e07-5695-4cca-a945-263d7db0c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-275950377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a894d9e-3072-461b-a171-52222fa1969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59f94e0080e4b3c86056eaf4cdc5d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:29Z,use_quota=True,user_id='bd8b81303cb241658f8b3cf621ae1f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb8aba8-ec43-49dc-b721-c34dfc69f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb8aba8-ec43-49dc-b721-c34dfc69f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2183c0a9-5ca1-41bf-88bf-6b1cdff08af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2183c0a9-5ca1-41bf-88bf-6b1cdff08af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a894d9e-3072-461b-a171-52222fa1969e', 'volume_name': 'volume-8a894d9e-3072-461b-a171-52222fa1969e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1446faee-46a4-49b8-b77c-2818a13b5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1446faee-46a4-49b8-b77c-2818a13b5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e987f12-46d0-4d02-98a6-e9b00bb5b49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Volume 8a894d9e-3072-461b-a171-52222fa1969e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a894d9e-3072-461b-a171-52222fa1969e', 'volume_size': 1}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" returned: 0 in 0.320s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d 1073741824" returned: 0 in 0.654s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8" released by "delete_volume" :: held 0.841s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:29 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d
Sep 11 23:09:29 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Created reservations ['528e1783-7fe2-45c9-92c1-18f36e6b2668', '47bddd2f-ddd6-4f58-bbf4-b60036e0879b', '1dddf714-d873-44bd-aa5b-dddd6ae2e363', 'ab64865b-b2de-45d7-9c33-cd5211cdac44'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:29 devstack sudo[97915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:29 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:29 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.383s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-275950377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a894d9e-3072-461b-a171-52222fa1969e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59f94e0080e4b3c86056eaf4cdc5d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:29Z,use_quota=True,user_id='bd8b81303cb241658f8b3cf621ae1f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Creating volume 8a894d9e-3072-461b-a171-52222fa1969e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:29 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-cdb72b1c-7fdf-4063-8491-3c002c3cbabe-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:29 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e 1073741824
Sep 11 23:09:29 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4c3136-a48a-4ba0-9138-7eac031d342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de002683-bfbd-4b32-8af5-1e49f468a29d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322866c3-88a9-4a02-a8dd-dabbbb691caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "cinder-cdb72b1c-7fdf-4063-8491-3c002c3cbabe-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Volume volume-de002683-bfbd-4b32-8af5-1e49f468a29d (de002683-bfbd-4b32-8af5-1e49f468a29d): created successfully
Sep 11 23:09:29 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322866c3-88a9-4a02-a8dd-dabbbb691caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Flow 'volume_create_manager' (8db753fc-fd35-4190-98b8-dbe4f5ccf84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.358s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Deleted volume successfully.
Sep 11 23:09:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b106ba93-5cc3-4342-8ace-a518313d5b7a tempest-AttachVolumeNegativeTest-2066173202 None] Created volume successfully.
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Acquiring lock "cinder-quobyte-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9a87d0b6-635a-4627-97f9-a95576d2f6b6 tempest-VolumesCloneTest-1051619076 None] Lock "cinder-8cb57f7a-ef6e-4fcb-8e06-674e4c2052f8-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72e567e-cd20-43c1-9c08-01d5db12b863]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:29 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:29 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:30 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e 1073741824" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:30 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e
Sep 11 23:09:30 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:30 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.411s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:30 devstack sudo[97932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe
Sep 11 23:09:30 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:30 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e987f12-46d0-4d02-98a6-e9b00bb5b49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a894d9e-3072-461b-a171-52222fa1969e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37937570-1e30-48b2-a713-6f4200031555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Volume volume-8a894d9e-3072-461b-a171-52222fa1969e (8a894d9e-3072-461b-a171-52222fa1969e): created successfully
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37937570-1e30-48b2-a713-6f4200031555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:30 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Flow 'volume_create_manager' (768761f8-ce4e-4cef-a247-af31f7904905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" returned: 0 in 0.299s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "cinder-quobyte-cdb72b1c-7fdf-4063-8491-3c002c3cbabe" released by "delete_volume" :: held 0.780s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-242e2ca6-e093-4206-bc15-493c89bbe7a3 tempest-VolumesTransfersV357Test-239978025 None] Created volume successfully.
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Created reservations ['e747be30-592e-4e4a-93ef-dcedc14cf5c5', '285a032e-59f3-4bdd-a87e-98fd3c4e91d5', '9625e920-632c-4ace-8a74-97495c51e661', '456eef56-d530-4ac6-8664-fbcc13342001'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:30 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:30 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:30 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.311s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:30 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Deleted volume successfully.
Sep 11 23:09:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5d52f7ed-510b-42b3-9cee-5ec0462d429e tempest-VolumesCloneTest-1051619076 None] Lock "cinder-cdb72b1c-7fdf-4063-8491-3c002c3cbabe-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eadc2284-a350-4066-a944-1410051dc6bb req-b26e0e0c-3483-42c8-bb88-03978f28077e tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eadc2284-a350-4066-a944-1410051dc6bb req-b26e0e0c-3483-42c8-bb88-03978f28077e tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eadc2284-a350-4066-a944-1410051dc6bb req-b26e0e0c-3483-42c8-bb88-03978f28077e tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-eadc2284-a350-4066-a944-1410051dc6bb req-b26e0e0c-3483-42c8-bb88-03978f28077e tempest-AttachVolumeNegativeTest-2066173202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-de002683-bfbd-4b32-8af5-1e49f468a29d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebf7f665-42c1-4ddc-9cb5-e91b7c5b33b8', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:09:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bcb1f83e-ae8f-4d4f-a338-39ca93243c17 tempest-VolumesTransfersV357Test-570450703 None] Transfer volume completed successfully.
Sep 11 23:09:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-eadc2284-a350-4066-a944-1410051dc6bb req-b26e0e0c-3483-42c8-bb88-03978f28077e tempest-AttachVolumeNegativeTest-2066173202 None] attachment_update completed successfully.
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "cinder-8a894d9e-3072-461b-a171-52222fa1969e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-8a894d9e-3072-461b-a171-52222fa1969e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "cinder-quobyte-8a894d9e-3072-461b-a171-52222fa1969e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-quobyte-8a894d9e-3072-461b-a171-52222fa1969e" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3957f472-ea27-4c4b-ae14-417685817813]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:33 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e
Sep 11 23:09:33 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:33 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e" returned: 0 in 0.442s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:33 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e
Sep 11 23:09:33 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:34 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8a894d9e-3072-461b-a171-52222fa1969e" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-quobyte-8a894d9e-3072-461b-a171-52222fa1969e" released by "delete_volume" :: held 0.796s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Created reservations ['8336d7ee-9d85-40cb-baf0-613ef081c8d6', '61f72975-9cea-4575-bb63-fa2cba9296c8', '07adebd3-aade-48ef-87ce-dec00f012a90', '8c246427-087b-4bad-bb32-8268f70ae875'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:34 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:34 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:34 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Deleted volume successfully.
Sep 11 23:09:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc9f21a9-3b47-4e8b-8511-db16186b03ca tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-8a894d9e-3072-461b-a171-52222fa1969e-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:35 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-983bb0bb-0a0d-40d5-836a-8154b651c924 req-442fb3a9-15a5-4ce8-9b64-f4a8ec26ef9a tempest-AttachVolumeNegativeTest-2066173202 None] Terminate volume connection completed successfully.
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-983bb0bb-0a0d-40d5-836a-8154b651c924 req-442fb3a9-15a5-4ce8-9b64-f4a8ec26ef9a tempest-AttachVolumeNegativeTest-2066173202 None] Deleting attachment ebf7f665-42c1-4ddc-9cb5-e91b7c5b33b8. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Flow 'volume_create_manager' (737a455a-0ef9-4e95-bfaa-b484a18c0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d1cc03-fb7c-4947-a1ef-2744ab1c7eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d1cc03-fb7c-4947-a1ef-2744ab1c7eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-576710175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0ccd41-88e4-49a0-b6db-c1519f724537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59f94e0080e4b3c86056eaf4cdc5d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:36Z,use_quota=True,user_id='bd8b81303cb241658f8b3cf621ae1f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c2d4bd-2889-41e4-af38-763ff766bb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c2d4bd-2889-41e4-af38-763ff766bb21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be6c52a-0513-4859-9e72-a0fe8c455e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6be6c52a-0513-4859-9e72-a0fe8c455e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0ccd41-88e4-49a0-b6db-c1519f724537', 'volume_name': 'volume-5b0ccd41-88e4-49a0-b6db-c1519f724537', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40063850-7d86-4781-9cc6-0d078fa5f196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40063850-7d86-4781-9cc6-0d078fa5f196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cb4cbe-f726-4a75-9f1c-2b95a4fd51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Volume 5b0ccd41-88e4-49a0-b6db-c1519f724537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0ccd41-88e4-49a0-b6db-c1519f724537', 'volume_size': 1}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-576710175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0ccd41-88e4-49a0-b6db-c1519f724537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a59f94e0080e4b3c86056eaf4cdc5d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:36Z,use_quota=True,user_id='bd8b81303cb241658f8b3cf621ae1f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Creating volume 5b0ccd41-88e4-49a0-b6db-c1519f724537 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:35 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:35 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 1073741824
Sep 11 23:09:35 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:36 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 1073741824" returned: 0 in 0.909s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:36 devstack sudo[98399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537
Sep 11 23:09:36 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Flow 'volume_create_manager' (4f475a8a-872c-47ba-9e2b-0f9ea70ca761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3fd2b0-7447-42c7-8e59-b0d96dee7041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3fd2b0-7447-42c7-8e59-b0d96dee7041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-706489103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b516af8-c275-46ff-a00c-25713b7999a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d90b877ddd481bbc5516f09e269f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:37Z,use_quota=True,user_id='4257688b265746cba1f0379bae3cabe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149d4fda-27d0-46e5-9b96-42ab8b16b5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149d4fda-27d0-46e5-9b96-42ab8b16b5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b165de-77a3-4a42-a773-8faa98fa6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b165de-77a3-4a42-a773-8faa98fa6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b516af8-c275-46ff-a00c-25713b7999a5', 'volume_name': 'volume-3b516af8-c275-46ff-a00c-25713b7999a5', 'volume_size': 2}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153a528a-012f-4f6a-bc09-03a046a34dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (153a528a-012f-4f6a-bc09-03a046a34dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2177f800-2570-4bdf-ab78-355133dfe013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:36 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Volume 3b516af8-c275-46ff-a00c-25713b7999a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b516af8-c275-46ff-a00c-25713b7999a5', 'volume_size': 2}
Sep 11 23:09:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:37 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.190s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-706489103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b516af8-c275-46ff-a00c-25713b7999a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d90b877ddd481bbc5516f09e269f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:09:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:09:37Z,use_quota=True,user_id='4257688b265746cba1f0379bae3cabe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Creating volume 3b516af8-c275-46ff-a00c-25713b7999a5 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:09:37 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 2147483648 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cb4cbe-f726-4a75-9f1c-2b95a4fd51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0ccd41-88e4-49a0-b6db-c1519f724537', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c5a697-052f-46e8-834a-6b8271be14c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:37 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 2147483648
Sep 11 23:09:37 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:37 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Volume volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 (5b0ccd41-88e4-49a0-b6db-c1519f724537): created successfully
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c5a697-052f-46e8-834a-6b8271be14c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Flow 'volume_create_manager' (737a455a-0ef9-4e95-bfaa-b484a18c0019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3d250ffa-6339-404f-a13c-47b9cb703e2a tempest-VolumesTransfersV357Test-239978025 None] Created volume successfully.
Sep 11 23:09:37 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 2147483648" returned: 0 in 0.751s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:38 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5
Sep 11 23:09:38 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "cinder-5b0ccd41-88e4-49a0-b6db-c1519f724537-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-5b0ccd41-88e4-49a0-b6db-c1519f724537-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Acquiring lock "cinder-1cae6285-3658-468a-918a-cf364707622c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "cinder-quobyte-5b0ccd41-88e4-49a0-b6db-c1519f724537" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "cinder-1cae6285-3658-468a-918a-cf364707622c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-quobyte-5b0ccd41-88e4-49a0-b6db-c1519f724537" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bc2887-38b6-4526-a002-dce931f45a37]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Acquiring lock "cinder-quobyte-1cae6285-3658-468a-918a-cf364707622c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "cinder-quobyte-1cae6285-3658-468a-918a-cf364707622c" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5" returned: 0 in 0.430s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2177f800-2570-4bdf-ab78-355133dfe013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b516af8-c275-46ff-a00c-25713b7999a5', 'volume_size': 2}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f926454-df49-4108-aaba-8a9e31c555bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ce1dc-fcf8-4db1-b808-fd9b7051f0db]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Volume volume-3b516af8-c275-46ff-a00c-25713b7999a5 (3b516af8-c275-46ff-a00c-25713b7999a5): created successfully
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f926454-df49-4108-aaba-8a9e31c555bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:09:38 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537
Sep 11 23:09:38 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Flow 'volume_create_manager' (4f475a8a-872c-47ba-9e2b-0f9ea70ca761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:09:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-668bd2a1-042b-4cf8-8d20-ad64009f7e2c tempest-VolumesCloneNegativeTest-1612114597 None] Created volume successfully.
Sep 11 23:09:38 devstack sudo[98415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c
Sep 11 23:09:38 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:38 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Acquiring lock "cinder-3b516af8-c275-46ff-a00c-25713b7999a5-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "cinder-3b516af8-c275-46ff-a00c-25713b7999a5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:38 devstack sudo[98426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537
Sep 11 23:09:38 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Acquiring lock "cinder-quobyte-3b516af8-c275-46ff-a00c-25713b7999a5" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "cinder-quobyte-3b516af8-c275-46ff-a00c-25713b7999a5" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:39 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96623f8-ca47-499e-8eb3-9ec317501e57]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c" returned: 0 in 0.615s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:39 devstack sudo[98430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c
Sep 11 23:09:39 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:39 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5
Sep 11 23:09:39 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:39 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5b0ccd41-88e4-49a0-b6db-c1519f724537" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-quobyte-5b0ccd41-88e4-49a0-b6db-c1519f724537" released by "delete_volume" :: held 1.026s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:39 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1cae6285-3658-468a-918a-cf364707622c" returned: 0 in 0.344s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "cinder-quobyte-1cae6285-3658-468a-918a-cf364707622c" released by "delete_volume" :: held 1.032s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Created reservations ['991e1277-b7e6-406c-a5ec-9d44c56567d6', '39e22918-82d8-4bde-a281-679643641f76', 'da8fbb35-00da-4ff0-9177-3900c945b9fa', '0ed08bf6-85a1-4147-9f9a-4b8d4966e1fe'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Created reservations ['37969336-5018-4c29-a7bc-9e8107347c21', 'b2166999-0bf1-43de-8aff-9dacccdf53d8', 'e3fc4236-8e66-41b8-bbf3-e37cb162f9b1', 'ca617c62-85b4-4d46-b987-e430e08ad15a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:39 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:39 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:39 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5" returned: 0 in 0.557s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:39 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:39 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:39 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5
Sep 11 23:09:39 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:39 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Deleted volume successfully.
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2caed522-fef4-4a66-93e7-4484b8202978 tempest-VolumesTransfersV357Test-2090051045 None] Lock "cinder-5b0ccd41-88e4-49a0-b6db-c1519f724537-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:39 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Deleted volume successfully.
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6b2d176a-8998-4691-abd7-b51b5b0791f7 tempest-VolumesNegativeTest-1070043637 None] Lock "cinder-1cae6285-3658-468a-918a-cf364707622c-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:39 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b516af8-c275-46ff-a00c-25713b7999a5" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "cinder-quobyte-3b516af8-c275-46ff-a00c-25713b7999a5" released by "delete_volume" :: held 0.914s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Created reservations ['dc9de3df-f213-4fad-a113-575723f74434', '5c342cb2-320f-4d44-ace7-b71da5d26aac', '9ae4d163-80f2-4ed3-b4b1-45cbf651d508', 'd3d9aed8-4e25-4bd4-aac5-b56a235ff339'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:40 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:40 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:40 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Deleted volume successfully.
Sep 11 23:09:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d642d359-0c6d-449b-a5e9-599352a2267a tempest-VolumesCloneNegativeTest-1612114597 None] Lock "cinder-3b516af8-c275-46ff-a00c-25713b7999a5-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-de002683-bfbd-4b32-8af5-1e49f468a29d-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-de002683-bfbd-4b32-8af5-1e49f468a29d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=137,cinder:INSERT=55,cinder:UPDATE=178,cinder:DELETE=12 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-quobyte-de002683-bfbd-4b32-8af5-1e49f468a29d" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-de002683-bfbd-4b32-8af5-1e49f468a29d" acquired by "delete_volume" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb17d8-d821-48bc-a734-c799fbcdbb6d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:41 devstack sudo[98450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d
Sep 11 23:09:41 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:42 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d" returned: 0 in 0.504s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:42 devstack sudo[98457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d
Sep 11 23:09:42 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:42 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-de002683-bfbd-4b32-8af5-1e49f468a29d" returned: 0 in 0.329s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-de002683-bfbd-4b32-8af5-1e49f468a29d" released by "delete_volume" :: held 0.911s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Created reservations ['572abd14-53b2-4b9d-98e2-252deb4e889b', 'db9a5d5b-e3e4-408f-b7ac-04cb237ece4b', 'ac5dd668-3c14-43ce-aaeb-7c9bc75d886a', '0f3b2884-4cc6-4087-8019-a7e5ec9c934f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:42 devstack sudo[98460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:42 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:42 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Deleted volume successfully.
Sep 11 23:09:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-69befb25-4fca-4251-9437-caf8c115b306 tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-de002683-bfbd-4b32-8af5-1e49f468a29d-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-quobyte-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[652f8e70-343c-459c-ac42-f3da865ee881]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:44 devstack sudo[98463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b
Sep 11 23:09:44 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:44 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" returned: 0 in 0.495s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:44 devstack sudo[98468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b
Sep 11 23:09:44 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:44 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b" released by "delete_volume" :: held 0.831s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Created reservations ['d68a60d4-bd24-4e28-9ebf-a10dd809a2f0', '9903cd12-cf1f-457d-b2a0-9e864c98aa11', '09d89b5e-dd9f-41d9-96d1-1086d857010b', '44818047-b2d4-4677-b199-4e905b9b1e91'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:45 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:45 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:45 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.403s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "cinder-quobyte-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:09:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Deleted volume successfully.
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" acquired by "delete_volume" :: waited 0.050s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-68d40ebf-0da8-4d83-b9c7-dd669021f76b tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-d452d19f-80a0-4b4e-b0cf-a663bf0a3a5b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77863571-001e-4872-ab67-2f977d4f847e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:09:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:45 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3
Sep 11 23:09:45 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:46 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" returned: 0 in 0.536s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:46 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:46 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:46 devstack sudo[98481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3
Sep 11 23:09:46 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:46 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:09:46 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-quobyte-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3" released by "delete_volume" :: held 1.010s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Created reservations ['c0f698e9-8aa9-4cdc-9ed8-0292efb3bb29', 'ef2850a9-ec80-4906-83ca-faffc3424666', 'd80eaeac-db9b-4c28-98e8-54e2e89eb4c5', 'd2448f1e-a0b0-40f8-970f-032bc572d84e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:09:46 devstack sudo[98486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:09:46 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:09:46 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:09:46 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Deleted volume successfully.
Sep 11 23:09:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ad3ca0e0-f900-4593-bf33-4250671dacee tempest-AttachVolumeNegativeTest-2066173202 None] Lock "cinder-6eff2c8a-8c2e-4b8e-aa01-8bfdc2a8c6f3-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:09:56 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=17,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:10:00 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=85,cinder:INSERT=20,cinder:SELECT=66,cinder:DELETE=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:10:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e8d9d2f1-f245-43a4-b0e6-3840ab1dfc08 tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-766923365: creating
Sep 11 23:10:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e8d9d2f1-f245-43a4-b0e6-3840ab1dfc08 tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-766923365: created successfully
Sep 11 23:10:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e8d9d2f1-f245-43a4-b0e6-3840ab1dfc08 tempest-GroupSnapshotsTest-1296371741 None] Create group completed successfully.
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (7802c371-48a1-4d0e-b327-28c1e873c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a7922b-6bc8-4a5f-82f6-affed18190c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a7922b-6bc8-4a5f-82f6-affed18190c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385029108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=486b3f10-d58b-4c9e-9929-1121b97c72c2,host='devstack@QuobyteHD#QuobyteHD',id=bef4c343-e7f8-4160-a4fc-0b273514476b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:15Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff55f0bb-fd94-4d4f-86e0-0aaed6120088),volume_type_id=ff55f0bb-fd94-4d4f-86e0-0aaed6120088)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd8d810-953f-443a-8896-7294fe5d1d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd8d810-953f-443a-8896-7294fe5d1d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e1d647-a68e-45ea-8e2b-80c008b1d6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e1d647-a68e-45ea-8e2b-80c008b1d6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bef4c343-e7f8-4160-a4fc-0b273514476b', 'volume_name': 'volume-bef4c343-e7f8-4160-a4fc-0b273514476b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc184680-0cb0-40b7-ae40-42d83e918e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc184680-0cb0-40b7-ae40-42d83e918e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e927b9-838d-424f-93fd-5f4bd04df1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Volume bef4c343-e7f8-4160-a4fc-0b273514476b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bef4c343-e7f8-4160-a4fc-0b273514476b', 'volume_size': 1}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=486b3f10-d58b-4c9e-9929-1121b97c72c2,created_at=2026-09-11T21:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-385029108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=486b3f10-d58b-4c9e-9929-1121b97c72c2,host='devstack@QuobyteHD#QuobyteHD',id=bef4c343-e7f8-4160-a4fc-0b273514476b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:15Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff55f0bb-fd94-4d4f-86e0-0aaed6120088),volume_type_id=ff55f0bb-fd94-4d4f-86e0-0aaed6120088)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Creating volume bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:10:15 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:15 devstack sudo[98538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b 1073741824
Sep 11 23:10:15 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:15 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b 1073741824" returned: 0 in 0.529s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:15 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:15 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:15 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:10:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e927b9-838d-424f-93fd-5f4bd04df1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bef4c343-e7f8-4160-a4fc-0b273514476b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2c7484-1d14-4e07-a5d4-9426bc748915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Volume volume-bef4c343-e7f8-4160-a4fc-0b273514476b (bef4c343-e7f8-4160-a4fc-0b273514476b): created successfully
Sep 11 23:10:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2c7484-1d14-4e07-a5d4-9426bc748915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (7802c371-48a1-4d0e-b327-28c1e873c023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-035d3404-c004-41ed-9bb5-b548da3d4e62 tempest-GroupSnapshotsTest-1296371741 None] Created volume successfully.
Sep 11 23:10:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] GroupSnapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: creating.
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Group snapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: creating. {{(pid=88022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Creating offline snapshot a58ac103-d0e0-4c04-878c-099205cbdb9a of volume bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8350b-624e-4043-b9c6-395d6b802e06]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:18 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:18 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:18 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 0.594s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:18 devstack sudo[98554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a 1G
Sep 11 23:10:18 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:19 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a 1G" returned: 0 in 0.704s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef4c343-e7f8-4160-a4fc-0b273514476b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:19 devstack sudo[98560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef4c343-e7f8-4160-a4fc-0b273514476b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:19 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Flow 'volume_create_manager' (2636a8b1-9b85-4229-9ada-391fe22cbace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a6041-452b-4991-835f-fa6e4485bc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca1a6041-452b-4991-835f-fa6e4485bc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854153170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49736ca-dae7-49ab-bb32-be0f203a0e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35bea9b0da43789c3412861a77e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:19Z,use_quota=True,user_id='4b37e40353884a0cba3017b8248f28ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab375625-56ff-42f1-9547-230a2098c073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab375625-56ff-42f1-9547-230a2098c073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ae6c06-d4cc-484c-8921-5157e967d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4ae6c06-d4cc-484c-8921-5157e967d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49736ca-dae7-49ab-bb32-be0f203a0e9b', 'volume_name': 'volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d0c9ba-8762-45de-af0f-2bea143f5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6d0c9ba-8762-45de-af0f-2bea143f5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8d0d7f-5a98-470d-a496-be34ddaa1b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Volume c49736ca-dae7-49ab-bb32-be0f203a0e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b', 'volume_size': 1}
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:19 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bef4c343-e7f8-4160-a4fc-0b273514476b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 0.405s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:19 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:10:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:19 devstack sudo[98566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:19 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:20 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:20 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info
Sep 11 23:10:20 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Flow 'volume_create_manager' (7a1a51eb-077c-4567-a9b7-9ae4b9d8b109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb250d8-dc2f-48cb-8e30-35a504c4506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb250d8-dc2f-48cb-8e30-35a504c4506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2080980585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c856651-9bda-4844-be85-a2b32903c140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817bece3a361400f8dce27dff851dbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:20Z,use_quota=True,user_id='48a6c63b00284380b619c03aea7486de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973a475c-8ecc-438c-8a67-8448b4ccd4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (973a475c-8ecc-438c-8a67-8448b4ccd4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371cd10-bd52-46d1-b3cd-adf105be6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2371cd10-bd52-46d1-b3cd-adf105be6546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c856651-9bda-4844-be85-a2b32903c140', 'volume_name': 'volume-7c856651-9bda-4844-be85-a2b32903c140', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f4e494-107d-4069-a7ff-1dae78d66271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f4e494-107d-4069-a7ff-1dae78d66271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed19c96-b51a-4794-b335-af406a6b194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Volume 7c856651-9bda-4844-be85-a2b32903c140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c856651-9bda-4844-be85-a2b32903c140', 'volume_size': 1}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:20 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:20 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:20 devstack sudo[98572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info
Sep 11 23:10:20 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:20 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.info" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.242s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-854153170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49736ca-dae7-49ab-bb32-be0f203a0e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca35bea9b0da43789c3412861a77e940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:19Z,use_quota=True,user_id='4b37e40353884a0cba3017b8248f28ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Creating volume c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:10:20 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:10:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:20 devstack sudo[98575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b 1073741824
Sep 11 23:10:20 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8550da9a-73a1-4d9e-8610-b0c097e6c879 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: created successfully
Sep 11 23:10:21 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b 1073741824" returned: 0 in 0.645s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:21 devstack sudo[98581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:10:21 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:21 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.361s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2080980585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c856651-9bda-4844-be85-a2b32903c140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817bece3a361400f8dce27dff851dbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:20Z,use_quota=True,user_id='48a6c63b00284380b619c03aea7486de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Creating volume 7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:10:21 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:21 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 1073741824
Sep 11 23:10:21 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c8d0d7f-5a98-470d-a496-be34ddaa1b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af86493-ee76-4384-b87d-64008049e12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:21 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Volume volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b (c49736ca-dae7-49ab-bb32-be0f203a0e9b): created successfully
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af86493-ee76-4384-b87d-64008049e12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Flow 'volume_create_manager' (2636a8b1-9b85-4229-9ada-391fe22cbace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6cf49a5d-8020-469a-9a33-5fdb1ff8adbf tempest-VolumesActionsTest-796310222 None] Created volume successfully.
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:22 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 1073741824" returned: 0 in 0.608s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:22 devstack sudo[98590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:10:22 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:22 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.670s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a-53cbf882-fc9a-456f-929e-3bdd6f1f6719" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed19c96-b51a-4794-b335-af406a6b194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c856651-9bda-4844-be85-a2b32903c140', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99f86a7-b584-49ce-964f-1d72a3bb8297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a-53cbf882-fc9a-456f-929e-3bdd6f1f6719" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Creating volume 53cbf882-fc9a-456f-929e-3bdd6f1f6719 from snapshot a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Volume volume-7c856651-9bda-4844-be85-a2b32903c140 (7c856651-9bda-4844-be85-a2b32903c140): created successfully
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99f86a7-b584-49ce-964f-1d72a3bb8297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Flow 'volume_create_manager' (7a1a51eb-077c-4567-a9b7-9ae4b9d8b109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3390162a-966a-4bc5-bcdd-cd640dd992ce tempest-TestImageHashVerification-1403025905 None] Created volume successfully.
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] snapshot: a58ac103-d0e0-4c04-878c-099205cbdb9a, volume: 53cbf882-fc9a-456f-929e-3bdd6f1f6719,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[33029684-c5b1-483f-91e5-a95467abdb62]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:23 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:23 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:23 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 0.507s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bef4c343-e7f8-4160-a4fc-0b273514476b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:10:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91afdc-d3f4-44f1-9257-8a43cf1ce9f2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:23 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:23 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:24 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 0.536s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:24 devstack sudo[98613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719
Sep 11 23:10:24 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:29 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719" returned: 0 in 5.837s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:29 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:10:29 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Converted 1024.00 MB image at 175.39 MB/s
Sep 11 23:10:29 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:10:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:29 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719
Sep 11 23:10:29 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:30 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" released by "_copy_volume_from_snapshot" :: held 7.306s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a-53cbf882-fc9a-456f-929e-3bdd6f1f6719" released by "_create_volume_from_snapshot" :: held 7.409s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.438s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.748s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4306da78-a336-48da-87f8-bf04bcc03e60]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc81f7aa-701e-4cf0-8047-8ff3076ea54f tempest-GroupSnapshotsTest-1296371741 None] Create group from source-snapshot-d456a09a-5755-41fb-9e5e-7b2610e3c376 completed successfully.
Sep 11 23:10:30 devstack sudo[98650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:10:30 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:30 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.508s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2190473f-1e84-4281-9ceb-d10153530a1a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:30 devstack sudo[98656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:10:30 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:31 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.567s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 /opt/stack/data/cinder/conversion/7c856651-9bda-4844-be85-a2b32903c140.temp_image.97df766c-dde8-47b0-83d3-5ac97efe15f6viokrstu.img {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:31 devstack sudo[98662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 /opt/stack/data/cinder/conversion/7c856651-9bda-4844-be85-a2b32903c140.temp_image.97df766c-dde8-47b0-83d3-5ac97efe15f6viokrstu.img
Sep 11 23:10:31 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" acquired by "delete_volume" :: waited 0.044s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b046cb9-c779-448e-b480-a1a46d7ea999]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:32 devstack sudo[98690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719
Sep 11 23:10:32 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:33 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719" returned: 0 in 1.817s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:33 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719
Sep 11 23:10:33 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:34 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-53cbf882-fc9a-456f-929e-3bdd6f1f6719" returned: 0 in 0.965s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-53cbf882-fc9a-456f-929e-3bdd6f1f6719" released by "delete_volume" :: held 2.983s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:34 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['be5949f3-aeca-4723-9302-057d60220486'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:10:35 devstack cinder-volume[88022]: WARNING cinder.quota [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1848536537 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1848536537, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:10:35 devstack cinder-volume[88022]: WARNING cinder.quota [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1848536537 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1848536537, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['769410be-99f7-437d-9da5-3054611bc880', 'a66aee32-e58d-4641-ab74-44b15d5afd3d', 'ca41784e-3ba4-42d9-9917-d12b5ac245c1', '93e6aeea-8d53-4bf9-b68f-9293ab5e330d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:35 devstack sudo[98751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:10:35 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] group_snapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: deleting
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] group_snapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: deleting {{(pid=88022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" acquired by "delete_snapshot" :: waited 0.085s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Deleting offline snapshot a58ac103-d0e0-4c04-878c-099205cbdb9a of volume bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] snapshot_file for this snap is: volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:10:37 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 1.481s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95e2b6-26ba-4e44-8cb1-25bc28fffbeb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7c11c8c6-24d4-4d6a-af30-d8fbe0bd059b tempest-GroupSnapshotsTest-1296371741 None] Delete group completed successfully.
Sep 11 23:10:37 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:37 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cafbdde-8782-48c0-9747-633f444f2a34 tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" by "attach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cafbdde-8782-48c0-9747-633f444f2a34 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" acquired by "attach_volume" :: waited 0.059s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1cafbdde-8782-48c0-9747-633f444f2a34 tempest-VolumesActionsTest-796310222 None] Attaching volume c49736ca-dae7-49ab-bb32-be0f203a0e9b to instance f0745747-e162-4f52-b0b7-963f3fb9c5c4 at mountpoint /dev/vdb on host None.
Sep 11 23:10:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1cafbdde-8782-48c0-9747-633f444f2a34 tempest-VolumesActionsTest-796310222 None] Attach volume completed successfully.
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cafbdde-8782-48c0-9747-633f444f2a34 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" released by "attach_volume" :: held 0.413s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:39 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 2.271s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bef4c343-e7f8-4160-a4fc-0b273514476b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[742a8ba0-368f-49bd-9e15-65881a8ee95b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bea09f04-d4d7-4e1a-ab67-a658f3318d0f tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" by "detach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bea09f04-d4d7-4e1a-ab67-a658f3318d0f tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" acquired by "detach_volume" :: waited 0.090s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bea09f04-d4d7-4e1a-ab67-a658f3318d0f tempest-VolumesActionsTest-796310222 None] Detaching volume c49736ca-dae7-49ab-bb32-be0f203a0e9b from instance f0745747-e162-4f52-b0b7-963f3fb9c5c4.
Sep 11 23:10:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bea09f04-d4d7-4e1a-ab67-a658f3318d0f tempest-VolumesActionsTest-796310222 None] Detach volume completed successfully.
Sep 11 23:10:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bea09f04-d4d7-4e1a-ab67-a658f3318d0f tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" released by "detach_volume" :: held 0.313s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:40 devstack sudo[98775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:40 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:41 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 /opt/stack/data/cinder/conversion/7c856651-9bda-4844-be85-a2b32903c140.temp_image.97df766c-dde8-47b0-83d3-5ac97efe15f6viokrstu.img" returned: 0 in 9.959s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0515a10-ae09-4bf8-ab01-260592726627]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:41 devstack sudo[98789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:10:41 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:41 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 1.980s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:41 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:41 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:42 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.893s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140, size 1024.00 MB, duration 9.96 sec, destination /opt/stack/data/cinder/conversion/7c856651-9bda-4844-be85-a2b32903c140.temp_image.97df766c-dde8-47b0-83d3-5ac97efe15f6viokrstu.img {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:10:42 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Converted 1024.00 MB image at 102.78 MB/s
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] 97df766c-dde8-47b0-83d3-5ac97efe15f6 was raw, no need to convert to raw {{(pid=88022) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 11 23:10:42 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 0.575s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:42 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a
Sep 11 23:10:42 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:42 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b.a58ac103-d0e0-4c04-878c-099205cbdb9a" returned: 0 in 0.458s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-a58ac103-d0e0-4c04-878c-099205cbdb9a" released by "_delete_snapshot" :: held 5.625s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" released by "delete_snapshot" :: held 5.699s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:43 devstack cinder-volume[88022]: WARNING cinder.quota [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1848536537 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1848536537, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:10:43 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['f953c905-fb09-4d2e-9b70-6b566ac2b1dc', 'be0ef9f3-5912-430d-bca5-9123ea821009', 'cbdf33b9-8744-4d85-a033-d385e2cc3ca6', '72983af0-81f7-4015-b876-40e598e51f55'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:10:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-632ea7ae-8734-44bf-b0c9-3de8702c2d4d tempest-GroupSnapshotsTest-1296371741 None] group_snapshot d456a09a-5755-41fb-9e5e-7b2610e3c376: deleted successfully
Sep 11 23:10:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" acquired by "delete_volume" :: waited 0.052s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b5d8eb-e5ff-497b-9e1a-f77ba0313378]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:10:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:44 devstack sudo[98891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:44 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:45 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 0.656s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:45 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b
Sep 11 23:10:45 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:45 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bef4c343-e7f8-4160-a4fc-0b273514476b" returned: 0 in 0.421s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-bef4c343-e7f8-4160-a4fc-0b273514476b" released by "delete_volume" :: held 1.308s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:46 devstack sudo[98914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:10:46 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['1a586c20-65b3-415c-ada9-699acc386bad'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:10:46 devstack cinder-volume[88022]: WARNING cinder.db.api [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1848536537']
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['ef9a8a6a-f0ab-4f6a-8c2f-8d49da31adf3', 'de46aec1-4cbf-44b5-bd85-7e5ce52c754c', '1c7bdc23-ecc0-4971-992a-4b775d02f0b8', 'ea1f11e7-8c84-451d-a714-a1188dad1b7a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:10:46 devstack sudo[98916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:10:46 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:10:46 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.915s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:10:47 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:10:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:10:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:10:47 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root
Sep 11 23:10:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.627s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:10:47 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:10:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e6f5197c-9079-4c37-8967-77cc66ca79e7 tempest-GroupSnapshotsTest-1296371741 None] Delete group completed successfully.
Sep 11 23:10:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3a12ccb8-12bc-453d-9031-57381582beb8 tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-8181649: creating
Sep 11 23:10:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3a12ccb8-12bc-453d-9031-57381582beb8 tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-8181649: created successfully
Sep 11 23:10:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3a12ccb8-12bc-453d-9031-57381582beb8 tempest-GroupSnapshotsTest-1296371741 None] Create group completed successfully.
Sep 11 23:10:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:10:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (9002c829-878c-472b-bcf2-90a057d6a5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18002cd3-e30d-4a18-87bd-1e9e6989d0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18002cd3-e30d-4a18-87bd-1e9e6989d0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943380723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,host='devstack@QuobyteHD#QuobyteHD',id=f859e684-9daf-4441-a6ed-08344c07a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:51Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65b4aa65-b050-421c-8b4f-bc63d1797c97),volume_type_id=65b4aa65-b050-421c-8b4f-bc63d1797c97)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fce4cb-a6da-4937-8eb6-34109a4897e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fce4cb-a6da-4937-8eb6-34109a4897e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ca4161-9217-46b3-8744-7b5f2d3fd88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ca4161-9217-46b3-8744-7b5f2d3fd88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f859e684-9daf-4441-a6ed-08344c07a4b3', 'volume_name': 'volume-f859e684-9daf-4441-a6ed-08344c07a4b3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6063c-fa96-4001-b5df-3a8e8853fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae6063c-fa96-4001-b5df-3a8e8853fa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b803b62-f3c9-4824-93c0-942aaf829e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Volume f859e684-9daf-4441-a6ed-08344c07a4b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f859e684-9daf-4441-a6ed-08344c07a4b3', 'volume_size': 1}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Flow 'volume_create_manager' (5bb4ee4f-fff7-403c-b21c-9b6f28d75437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c2150c-8c15-4124-b078-3554a00ec543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c2150c-8c15-4124-b078-3554a00ec543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-899365995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158d64e3-27b4-408e-ad0a-93770f8feff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d337a544f94f71bf060e0b1a01f8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:52Z,use_quota=True,user_id='04f53506cc32414d8297b939121d09af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf9170-0612-41e1-99fe-ff8b8a7b0ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6bf9170-0612-41e1-99fe-ff8b8a7b0ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9743a8e-f020-4583-b239-9fb02c792e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9743a8e-f020-4583-b239-9fb02c792e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158d64e3-27b4-408e-ad0a-93770f8feff3', 'volume_name': 'volume-158d64e3-27b4-408e-ad0a-93770f8feff3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4bed58-a823-46a3-b5bc-eb4565badb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4bed58-a823-46a3-b5bc-eb4565badb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c71de3-307f-4865-af91-5b14aaff6400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:10:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Volume 158d64e3-27b4-408e-ad0a-93770f8feff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158d64e3-27b4-408e-ad0a-93770f8feff3', 'volume_size': 1}
Sep 11 23:10:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:10:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc7c4391-eb90-40c8-bfa3-d4275b8a8c90 tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" by "attach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc7c4391-eb90-40c8-bfa3-d4275b8a8c90 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" acquired by "attach_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc7c4391-eb90-40c8-bfa3-d4275b8a8c90 tempest-VolumesActionsTest-796310222 None] Attaching volume c49736ca-dae7-49ab-bb32-be0f203a0e9b to instance eea61266-04c7-4d23-9652-6c3dc02844e2 at mountpoint /dev/vdb on host None.
Sep 11 23:10:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc7c4391-eb90-40c8-bfa3-d4275b8a8c90 tempest-VolumesActionsTest-796310222 None] Attach volume completed successfully.
Sep 11 23:10:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc7c4391-eb90-40c8-bfa3-d4275b8a8c90 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b" released by "attach_volume" :: held 0.222s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:10:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3b82ff82-95fb-4a85-8bb1-960ee530e8a3 tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" by "detach_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:10:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3b82ff82-95fb-4a85-8bb1-960ee530e8a3 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:10:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3b82ff82-95fb-4a85-8bb1-960ee530e8a3 tempest-VolumesActionsTest-796310222 None] Detaching volume c49736ca-dae7-49ab-bb32-be0f203a0e9b from instance eea61266-04c7-4d23-9652-6c3dc02844e2.
Sep 11 23:10:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3b82ff82-95fb-4a85-8bb1-960ee530e8a3 tempest-VolumesActionsTest-796310222 None] Detach volume completed successfully.
Sep 11 23:10:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3b82ff82-95fb-4a85-8bb1-960ee530e8a3 tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:11:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:08 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=63,cinder:UPDATE=47,cinder:DELETE=1,cinder:INSERT=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 42.105s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Uploaded volume to glance image-id: 97df766c-dde8-47b0-83d3-5ac97efe15f6. {{(pid=88022) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.192s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,created_at=2026-09-11T21:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1943380723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,host='devstack@QuobyteHD#QuobyteHD',id=f859e684-9daf-4441-a6ed-08344c07a4b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:51Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65b4aa65-b050-421c-8b4f-bc63d1797c97),volume_type_id=65b4aa65-b050-421c-8b4f-bc63d1797c97)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Creating volume f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:11:12 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=60,cinder:UPDATE=52,cinder:INSERT=14,cinder:DELETE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:11:12 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 1073741824
Sep 11 23:11:12 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7307dcee-4849-4990-baa7-326351770100 tempest-TestImageHashVerification-1403025905 None] Copy volume to image completed successfully.
Sep 11 23:11:12 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 1073741824" returned: 0 in 0.520s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:12 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3
Sep 11 23:11:12 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:13 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3" returned: 0 in 0.248s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.392s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-899365995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158d64e3-27b4-408e-ad0a-93770f8feff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02d337a544f94f71bf060e0b1a01f8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:10:52Z,use_quota=True,user_id='04f53506cc32414d8297b939121d09af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Creating volume 158d64e3-27b4-408e-ad0a-93770f8feff3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:11:13 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b803b62-f3c9-4824-93c0-942aaf829e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f859e684-9daf-4441-a6ed-08344c07a4b3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:13 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 1073741824
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2ede54-1406-4939-a140-62f7ac7a4af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:13 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Volume volume-f859e684-9daf-4441-a6ed-08344c07a4b3 (f859e684-9daf-4441-a6ed-08344c07a4b3): created successfully
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2ede54-1406-4939-a140-62f7ac7a4af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (9002c829-878c-472b-bcf2-90a057d6a5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:11:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-57ac8508-99e2-459d-8e57-d9a56d3a2b41 tempest-GroupSnapshotsTest-1296371741 None] Created volume successfully.
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Acquiring lock "cinder-7c856651-9bda-4844-be85-a2b32903c140-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "cinder-7c856651-9bda-4844-be85-a2b32903c140-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:11:13 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 1073741824" returned: 0 in 0.587s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Acquiring lock "cinder-quobyte-7c856651-9bda-4844-be85-a2b32903c140" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "cinder-quobyte-7c856651-9bda-4844-be85-a2b32903c140" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[559c271f-47fa-4659-ab51-cfd05d5357d0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:13 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3
Sep 11 23:11:13 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:14 devstack sudo[99121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:11:14 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:14 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3" returned: 0 in 0.311s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 10.454s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c71de3-307f-4865-af91-5b14aaff6400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158d64e3-27b4-408e-ad0a-93770f8feff3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86501d13-ff8c-4979-bce8-5a754139bb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[92455d45-13a9-43a6-9c59-e381df1024a5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Volume volume-158d64e3-27b4-408e-ad0a-93770f8feff3 (158d64e3-27b4-408e-ad0a-93770f8feff3): created successfully
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86501d13-ff8c-4979-bce8-5a754139bb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Flow 'volume_create_manager' (5bb4ee4f-fff7-403c-b21c-9b6f28d75437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:11:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c1e376f3-a24c-4c46-82ee-f6a9d463d5a4 tempest-TestMinimumBasicScenario-1391036782 None] Created volume successfully.
Sep 11 23:11:14 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.491s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:14 devstack sudo[99127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:14 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:11:14 devstack sudo[99130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140
Sep 11 23:11:14 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (0a3beb0b-16d6-4083-b586-db0cd40215e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6c59ff-39b1-4f58-b976-47f706aa359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6c59ff-39b1-4f58-b976-47f706aa359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585055961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,host='devstack@QuobyteHD#QuobyteHD',id=ab367a17-e2e4-4cbe-bc65-f9911c36b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:14Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65b4aa65-b050-421c-8b4f-bc63d1797c97),volume_type_id=65b4aa65-b050-421c-8b4f-bc63d1797c97)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7599f9a2-a85d-4a66-a024-724e562f98df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7599f9a2-a85d-4a66-a024-724e562f98df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37689d-3abf-4452-bad7-140435e78258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a37689d-3abf-4452-bad7-140435e78258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab367a17-e2e4-4cbe-bc65-f9911c36b888', 'volume_name': 'volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bd941a-f280-4865-a874-07ad62bbcd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bd941a-f280-4865-a874-07ad62bbcd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94d078e-90ea-470d-b878-34230740b59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Volume ab367a17-e2e4-4cbe-bc65-f9911c36b888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888', 'volume_size': 1}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:14 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.439s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:14 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7c856651-9bda-4844-be85-a2b32903c140" returned: 0 in 0.331s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "cinder-quobyte-7c856651-9bda-4844-be85-a2b32903c140" released by "delete_volume" :: held 0.880s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf221af2-a296-4c39-ba85-f16239579a63]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Created reservations ['337947f3-bb09-46b1-866d-7e255e700ac7', '61c5a2ec-5cb5-487e-8af0-2e02c571d3e3', '6b45c088-2ddc-45b5-bdb4-cd6bb0c07021', 'c9c0c775-1447-4651-875e-a4fec131d3db'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:11:14 devstack sudo[99137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:14 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:15 devstack sudo[99142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:11:15 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:15 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.481s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.35516a12-47b2-4bfa-a408-c99cdf6c6699nfm4xed2.img {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:15 devstack sudo[99149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.35516a12-47b2-4bfa-a408-c99cdf6c6699nfm4xed2.img
Sep 11 23:11:15 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:15 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:11:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Deleted volume successfully.
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82980abc-802e-4b5d-a38e-80fa8f374ae9 tempest-TestImageHashVerification-1403025905 None] Lock "cinder-7c856651-9bda-4844-be85-a2b32903c140-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:11:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eec59bc5-6ecd-4a32-b235-76e15045b6dd req-18907dc3-ff43-4fe4-8c6c-0a481af55d72 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:20 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.35516a12-47b2-4bfa-a408-c99cdf6c6699nfm4xed2.img" returned: 0 in 4.852s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb5d5a-6b61-40ad-9fa3-d515e2872cfc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:20 devstack sudo[99172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:20 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:20 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.566s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.35516a12-47b2-4bfa-a408-c99cdf6c6699nfm4xed2.img {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:11:20 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Converted 1024.00 MB image at 211.00 MB/s
Sep 11 23:11:20 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] 35516a12-47b2-4bfa-a408-c99cdf6c6699 was raw, no need to convert to raw {{(pid=88022) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Sep 11 23:11:24 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=18,cinder:SELECT=12,cinder:INSERT=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:11:30 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=3,cinder:SELECT=8 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.295s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Uploaded volume to glance image-id: 35516a12-47b2-4bfa-a408-c99cdf6c6699. {{(pid=88022) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.973s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,created_at=2026-09-11T21:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585055961',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d542f71f-95d5-4fc6-8084-1d5e7e46caf5,host='devstack@QuobyteHD#QuobyteHD',id=ab367a17-e2e4-4cbe-bc65-f9911c36b888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:11:14Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65b4aa65-b050-421c-8b4f-bc63d1797c97),volume_type_id=65b4aa65-b050-421c-8b4f-bc63d1797c97)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Creating volume ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:11:42 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:11:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-18b96d32-123c-4c26-8cd8-f27fabbb4fbf tempest-VolumesActionsTest-796310222 None] Copy volume to image completed successfully.
Sep 11 23:11:42 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 1073741824
Sep 11 23:11:42 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:43 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 1073741824" returned: 0 in 0.668s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:43 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888
Sep 11 23:11:43 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:43 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eec59bc5-6ecd-4a32-b235-76e15045b6dd req-18907dc3-ff43-4fe4-8c6c-0a481af55d72 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 27.975s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-eec59bc5-6ecd-4a32-b235-76e15045b6dd req-18907dc3-ff43-4fe4-8c6c-0a481af55d72 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94d078e-90ea-470d-b878-34230740b59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c287a6-770d-42be-90a8-c7f13b2c1d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:11:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Volume volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 (ab367a17-e2e4-4cbe-bc65-f9911c36b888): created successfully
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c287a6-770d-42be-90a8-c7f13b2c1d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (0a3beb0b-16d6-4083-b586-db0cd40215e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:11:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-eec59bc5-6ecd-4a32-b235-76e15045b6dd req-18907dc3-ff43-4fe4-8c6c-0a481af55d72 tempest-TestMinimumBasicScenario-1391036782 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-158d64e3-27b4-408e-ad0a-93770f8feff3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46130550-6917-4f01-97d9-9cf37c8ccf8d', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:11:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-db6d53d3-7711-4d84-8ac8-85e9293b7230 tempest-GroupSnapshotsTest-1296371741 None] Created volume successfully.
Sep 11 23:11:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-eec59bc5-6ecd-4a32-b235-76e15045b6dd req-18907dc3-ff43-4fe4-8c6c-0a481af55d72 tempest-TestMinimumBasicScenario-1391036782 None] attachment_update completed successfully.
Sep 11 23:11:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4a1b10bf-9961-4f39-bb86-94bba9472618 tempest-GroupSnapshotsTest-1296371741 None] Update group completed successfully.
Sep 11 23:11:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6626143-03f1-4be5-b73d-b8dee81e0668]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:44 devstack sudo[99585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:44 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:45 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.395s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[567d3f38-07b4-4fd1-8ef1-bb9bd8cd99b8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:45 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:45 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0234300a-7269-4872-b972-f59c3e0fe1c7 tempest-GroupSnapshotsTest-1296371741 None] Update group completed successfully.
Sep 11 23:11:45 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.532s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:45 devstack sudo[99596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img
Sep 11 23:11:45 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:46 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:11:46 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:46 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.722s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:11:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:11:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8c7885b0-1e1b-4f68-9f81-a493e62137f6 tempest-GroupSnapshotsTest-1296371741 None] Update group completed successfully.
Sep 11 23:11:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-aa3f808d-77a9-49c3-b1e3-57076a1c1c3b tempest-GroupSnapshotsTest-1296371741 None] Update group completed successfully.
Sep 11 23:11:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] GroupSnapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: creating.
Sep 11 23:11:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Group snapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: creating. {{(pid=88022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 23:11:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:51 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img" returned: 0 in 6.028s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3edad7b-4a98-4060-8e3d-4ffd1662f04d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:51 devstack sudo[99614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:51 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:52 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.701s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:11:52 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Converted 1024.00 MB image at 169.83 MB/s
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] b83f0961-ea99-4bb2-a119-79c328adbc18 was raw, converting to qcow2 {{(pid=88022) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426e211-1d19-4cfb-a5f2-ef3ff91d1b30]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:52 devstack sudo[99621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img
Sep 11 23:11:52 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:52 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img" returned: 0 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:53 devstack sudo[99625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img
Sep 11 23:11:53 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:53 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img" returned: 1 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:53 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd
Sep 11 23:11:53 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:53 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd" returned: 0 in 0.310s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Image conversion details: src /opt/stack/data/cinder/conversion/c49736ca-dae7-49ab-bb32-be0f203a0e9b.temp_image.b83f0961-ea99-4bb2-a119-79c328adbc18xxw_8ptx.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:11:53 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f31b4e-aa8b-43cf-b9a7-21d4fda6c135]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:53 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd
Sep 11 23:11:53 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:54 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ptz2_5pd" returned: 0 in 0.500s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.301s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Uploaded volume to glance image-id: b83f0961-ea99-4bb2-a119-79c328adbc18. {{(pid=88022) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.961s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Creating offline snapshot 14475044-a723-4697-ac78-bc08aa5592a0 of volume ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:11:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b4f75c55-81d5-470f-9104-78c24542684c tempest-VolumesActionsTest-796310222 None] Copy volume to image completed successfully.
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc83137-a9ff-4853-8463-3e97e57bba6f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:56 devstack sudo[99644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888
Sep 11 23:11:56 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:56 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888" returned: 0 in 0.577s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:56 devstack sudo[99656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 1G
Sep 11 23:11:56 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:57 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 1G" returned: 0 in 0.626s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:57 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0
Sep 11 23:11:57 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Acquiring lock "cinder-quobyte-c49736ca-dae7-49ab-bb32-be0f203a0e9b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "cinder-quobyte-c49736ca-dae7-49ab-bb32-be0f203a0e9b" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb47d7-929b-422d-9928-5a81d4387a04]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:57 devstack sudo[99664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:57 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:57 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0" returned: 0 in 0.542s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:57 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:11:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:57 devstack sudo[99669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0
Sep 11 23:11:57 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:58 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0" returned: 0 in 0.301s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:58 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.562s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:58 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info
Sep 11 23:11:58 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:58 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b
Sep 11 23:11:58 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:58 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info" returned: 0 in 0.340s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:58 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:58 devstack sudo[99681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info
Sep 11 23:11:58 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:58 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c49736ca-dae7-49ab-bb32-be0f203a0e9b" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "cinder-quobyte-c49736ca-dae7-49ab-bb32-be0f203a0e9b" released by "delete_volume" :: held 1.025s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Created reservations ['7dd32970-8171-4451-98ed-bed07ec9d698', '93b4c3ee-1c2d-4476-84e4-cf43ce1450a4', 'c6e1f2ef-7aea-4a14-a9e4-3a216020b1cc', '3197a886-9a27-4745-b408-5f8d0187709d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:11:58 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.info" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Creating offline snapshot 97f1ee8e-7aea-4111-8db6-0b9698846b3e of volume f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[33925968-a795-4de6-a745-f211ddc41e0b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:11:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:58 devstack sudo[99684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:11:58 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:59 devstack sudo[99685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3
Sep 11 23:11:59 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:59 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:11:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Deleted volume successfully.
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e690a09e-7b9e-4dba-810f-691b36012cfe tempest-VolumesActionsTest-796310222 None] Lock "cinder-c49736ca-dae7-49ab-bb32-be0f203a0e9b-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:11:59 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3" returned: 0 in 0.514s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:11:59 devstack sudo[99692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e 1G
Sep 11 23:11:59 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:11:59 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e 1G" returned: 0 in 0.567s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:11:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f859e684-9daf-4441-a6ed-08344c07a4b3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:00 devstack sudo[99699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f859e684-9daf-4441-a6ed-08344c07a4b3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e
Sep 11 23:12:00 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:00 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f859e684-9daf-4441-a6ed-08344c07a4b3 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e" returned: 0 in 0.343s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:00 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:12:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:00 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e
Sep 11 23:12:00 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:00 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:00 devstack sudo[99710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info
Sep 11 23:12:00 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:01 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:01 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:01 devstack sudo[99713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info
Sep 11 23:12:01 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:01 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.info" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-958aeeaa-8bfd-408c-8d69-7dc3410563d3 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: created successfully
Sep 11 23:12:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: deleting
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: deleting {{(pid=88022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 23:12:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-14475044-a723-4697-ac78-bc08aa5592a0" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-14475044-a723-4697-ac78-bc08aa5592a0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Deleting offline snapshot 14475044-a723-4697-ac78-bc08aa5592a0 of volume ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] snapshot_file for this snap is: volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2598d5-fc76-4ad8-9a04-983b54f93ddb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:02 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0
Sep 11 23:12:02 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:02 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0" returned: 0 in 0.446s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639437f-657d-45e8-aac0-3239edc38f05]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:02 devstack sudo[99721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888
Sep 11 23:12:02 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:03 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888" returned: 0 in 0.549s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:03 devstack sudo[99727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0
Sep 11 23:12:03 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Flow 'volume_create_manager' (263e0bd7-8188-4177-bd05-3dd930949b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb52652b-8d96-409e-bd4b-954e8c89dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb52652b-8d96-409e-bd4b-954e8c89dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2004543574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ecb4b-f268-4854-8308-db61b021a55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6017d90bcd964a179e7dab7dc8452de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:03Z,use_quota=True,user_id='1f095a398103404ba9758a88c26c5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eec67e-ed50-4142-85cf-e4e20342f3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8eec67e-ed50-4142-85cf-e4e20342f3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1989ce6-452b-4943-af52-3876745c251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1989ce6-452b-4943-af52-3876745c251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e91ecb4b-f268-4854-8308-db61b021a55c', 'volume_name': 'volume-e91ecb4b-f268-4854-8308-db61b021a55c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef0981-1e0e-466e-af0a-6db5a595d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ef0981-1e0e-466e-af0a-6db5a595d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06223f-fe57-4e2c-be09-db6a9d1356a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:03 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Volume e91ecb4b-f268-4854-8308-db61b021a55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e91ecb4b-f268-4854-8308-db61b021a55c', 'volume_size': 1}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2004543574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e91ecb4b-f268-4854-8308-db61b021a55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6017d90bcd964a179e7dab7dc8452de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:03Z,use_quota=True,user_id='1f095a398103404ba9758a88c26c5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Creating volume e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:03 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:03 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c 1073741824
Sep 11 23:12:03 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:03 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0" returned: 0 in 0.533s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:03 devstack sudo[99735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0
Sep 11 23:12:03 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:04 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888.14475044-a723-4697-ac78-bc08aa5592a0" returned: 0 in 0.384s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-14475044-a723-4697-ac78-bc08aa5592a0" released by "_delete_snapshot" :: held 2.066s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" released by "delete_snapshot" :: held 2.110s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-97f1ee8e-7aea-4111-8db6-0b9698846b3e" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-97f1ee8e-7aea-4111-8db6-0b9698846b3e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Deleting offline snapshot 97f1ee8e-7aea-4111-8db6-0b9698846b3e of volume f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] snapshot_file for this snap is: volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8ac8d-ef47-41ae-a7fe-9891525464af]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:04 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c 1073741824" returned: 0 in 0.681s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:04 devstack sudo[99771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:12:04 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:04 devstack sudo[99770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e
Sep 11 23:12:04 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:04 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.436s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a06223f-fe57-4e2c-be09-db6a9d1356a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e91ecb4b-f268-4854-8308-db61b021a55c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b041f-b577-427a-b9c9-35e4a4ebdf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:04 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:04 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Volume volume-e91ecb4b-f268-4854-8308-db61b021a55c (e91ecb4b-f268-4854-8308-db61b021a55c): created successfully
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806b041f-b577-427a-b9c9-35e4a4ebdf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Flow 'volume_create_manager' (263e0bd7-8188-4177-bd05-3dd930949b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e" returned: 0 in 0.637s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f859e684-9daf-4441-a6ed-08344c07a4b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:12:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6b612db9-2edd-4cdc-9c9d-b616744cb158 tempest-TestStampPattern-1099253805 None] Created volume successfully.
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc4ab17-c32a-4b76-afdb-eee3ea19ae41]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:05 devstack sudo[99781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3
Sep 11 23:12:05 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:05 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3" returned: 0 in 0.380s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:05 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e
Sep 11 23:12:05 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:05 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:05 devstack sudo[99792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e
Sep 11 23:12:05 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:06 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3.97f1ee8e-7aea-4111-8db6-0b9698846b3e" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-97f1ee8e-7aea-4111-8db6-0b9698846b3e" released by "_delete_snapshot" :: held 1.897s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" released by "delete_snapshot" :: held 1.921s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:06 devstack cinder-volume[88022]: WARNING cinder.quota [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1762826032 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1762826032, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:06 devstack cinder-volume[88022]: WARNING cinder.quota [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1762826032 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1762826032, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:06 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['9c0e6437-0a9b-40f0-938b-72a5d676f4e3', '02906f3f-42ac-48da-9f1f-5ad0b9fb5e84', '4d1d5f19-ee39-48ff-af8d-ea2af2668253', '64bfd920-d961-4943-8e10-0bf13372874b'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:06 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['a8238c61-f3ee-4543-8c2d-7824b34fcc4f', 'b077d8da-dedd-4721-b6c1-bd8ef63990d4', '25f92e0d-9733-452b-8499-a45571b89d29', 'b04e745c-8694-4c94-a395-317284f59e0d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6f7889c4-d7e6-44dc-840c-ad8ca70ad2f2 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot 2e127a09-b911-449f-ad3e-c3cb7baecf24: deleted successfully
Sep 11 23:12:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb78be4c-c374-44d4-90e2-31d1af3f48b6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:08 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888
Sep 11 23:12:08 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:09 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888" returned: 0 in 0.595s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:09 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888
Sep 11 23:12:09 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:09 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ab367a17-e2e4-4cbe-bc65-f9911c36b888" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-ab367a17-e2e4-4cbe-bc65-f9911c36b888" released by "delete_volume" :: held 1.115s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43f52f4-797a-4775-8837-f91ebfe31670]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:10 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3
Sep 11 23:12:10 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:10 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3" returned: 0 in 0.589s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:10 devstack sudo[99892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3
Sep 11 23:12:10 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:10 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f859e684-9daf-4441-a6ed-08344c07a4b3" returned: 0 in 0.440s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-f859e684-9daf-4441-a6ed-08344c07a4b3" released by "delete_volume" :: held 1.179s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:11 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['9a01e2d5-d2e6-4ccf-9182-c712fcfce30e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:11 devstack cinder-volume[88022]: WARNING cinder.quota [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1762826032 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1762826032, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:11 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['a08cee9f-b68c-465e-80e5-908a7724a823', 'dc0ac885-3294-4dd2-9a55-9d16527d29ba', 'a3fab0ef-311d-4d38-aec7-17f2a8f9e8ac', 'edfc8885-5ac7-401a-9fd9-478bb0513f59'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:11 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['76c8517f-4a79-417b-a0b7-0c3b1dcc8a8e', 'a3aeaa66-8538-4615-8cf3-982a7e1ce406', '1f7355e3-533a-4a53-8d27-5054715900b6', '6f2ec983-a7ec-4f24-982c-468c86044cd8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:12 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:12 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:12 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.732s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:12 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5eeeae3d-5d17-44dc-84b0-b25e5a3274b3 tempest-GroupSnapshotsTest-1296371741 None] Delete group completed successfully.
Sep 11 23:12:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-05e6faf5-9cf9-4570-900b-80425358193a tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-1014170268: creating
Sep 11 23:12:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-05e6faf5-9cf9-4570-900b-80425358193a tempest-GroupSnapshotsTest-1296371741 None] Group tempest-GroupSnapshotsTest-Group-1014170268: created successfully
Sep 11 23:12:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-05e6faf5-9cf9-4570-900b-80425358193a tempest-GroupSnapshotsTest-1296371741 None] Create group completed successfully.
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Flow 'volume_create_manager' (e3360585-d578-4140-9b44-d61b61433402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7fc8d2-18fc-4f2b-bc82-497a4fa875b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7fc8d2-18fc-4f2b-bc82-497a4fa875b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-99429109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352e527a-49fa-4a41-bbeb-c2a4b037e525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b7af5c38a4fbcab6ff4717e917550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:15Z,use_quota=True,user_id='eed65226355a43b8a51f5cd9459f7688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d3ab6b-32de-429d-aba2-878c16c4136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d3ab6b-32de-429d-aba2-878c16c4136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0617a76-2996-4544-9190-750b3fda9d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0617a76-2996-4544-9190-750b3fda9d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '352e527a-49fa-4a41-bbeb-c2a4b037e525', 'volume_name': 'volume-352e527a-49fa-4a41-bbeb-c2a4b037e525', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6658b60>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b73295-7469-4729-842c-7f7ec12fe05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b73295-7469-4729-842c-7f7ec12fe05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a7d341-a59b-4e22-85cc-a9113cd68cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Volume 352e527a-49fa-4a41-bbeb-c2a4b037e525: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-352e527a-49fa-4a41-bbeb-c2a4b037e525', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6658b60>}
Sep 11 23:12:15 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Trying to clone 352e527a-49fa-4a41-bbeb-c2a4b037e525 from image 414d8567-5d24-440f-be04-3f648fa33a01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (24b86685-863e-4d70-a43b-bd4833493e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6cc4c4-a632-4ec2-9f48-36fe9770fea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b6cc4c4-a632-4ec2-9f48-36fe9770fea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508306436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=16b9119d-b864-4a00-9235-271f17e8ec8b,host='devstack@QuobyteHD#QuobyteHD',id=0095c475-1d96-4cf8-b977-698c743cd140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:16Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5be028f-0771-44f9-85ce-9e392dcb81ad),volume_type_id=e5be028f-0771-44f9-85ce-9e392dcb81ad)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a45ae97-4d52-4c6f-8b3a-33fcb4fbb6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a45ae97-4d52-4c6f-8b3a-33fcb4fbb6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f6779-cc89-4b9f-a70a-c9cea2dac13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f6779-cc89-4b9f-a70a-c9cea2dac13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0095c475-1d96-4cf8-b977-698c743cd140', 'volume_name': 'volume-0095c475-1d96-4cf8-b977-698c743cd140', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3786ce71-8d1b-43ed-898a-4c706a49ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3786ce71-8d1b-43ed-898a-4c706a49ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca45e6d4-5e6d-4d7a-9d85-230a49e4cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Volume 0095c475-1d96-4cf8-b977-698c743cd140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0095c475-1d96-4cf8-b977-698c743cd140', 'volume_size': 1}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=16b9119d-b864-4a00-9235-271f17e8ec8b,created_at=2026-09-11T21:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-508306436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=16b9119d-b864-4a00-9235-271f17e8ec8b,host='devstack@QuobyteHD#QuobyteHD',id=0095c475-1d96-4cf8-b977-698c743cd140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cc18fbc8f66499d9b6cbb6c66fa34c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:16Z,use_quota=True,user_id='4b63fde298f64532a7dcfadf1a72442a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5be028f-0771-44f9-85ce-9e392dcb81ad),volume_type_id=e5be028f-0771-44f9-85ce-9e392dcb81ad)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Creating volume 0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:16 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:16 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 1073741824
Sep 11 23:12:16 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD, size 20.69 MB, duration 1.08 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:12:16 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Image download 20.69 MB at 19.08 MB/s
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881d3d8-57c4-4645-8a2b-ef6e1715f6cd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:17 devstack sudo[99972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD
Sep 11 23:12:17 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:17 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 1073741824" returned: 0 in 0.925s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:17 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 is fetched for user eed65226355a43b8a51f5cd9459f7688. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:12:17 devstack sudo[99981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140
Sep 11 23:12:17 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de8e545-d6fa-47a7-8874-56209c4e083b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:17 devstack sudo[99983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD
Sep 11 23:12:17 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:18 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140" returned: 0 in 0.541s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca45e6d4-5e6d-4d7a-9d85-230a49e4cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0095c475-1d96-4cf8-b977-698c743cd140', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bdfa1d-6f85-4fee-96e2-38f3d205a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Volume volume-0095c475-1d96-4cf8-b977-698c743cd140 (0095c475-1d96-4cf8-b977-698c743cd140): created successfully
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1bdfa1d-6f85-4fee-96e2-38f3d205a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Flow 'volume_create_manager' (24b86685-863e-4d70-a43b-bd4833493e3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8f5b45ec-af51-4197-bf87-a2e16d437096 tempest-GroupSnapshotsTest-1296371741 None] Created volume successfully.
Sep 11 23:12:18 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD" returned: 0 in 0.636s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-99429109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352e527a-49fa-4a41-bbeb-c2a4b037e525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b7af5c38a4fbcab6ff4717e917550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:15Z,use_quota=True,user_id='eed65226355a43b8a51f5cd9459f7688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Creating volume 352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:18 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:18 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1073741824
Sep 11 23:12:18 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:18 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1073741824" returned: 0 in 0.522s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:18 devstack sudo[99996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525
Sep 11 23:12:18 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:19 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Attempting download of 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 352e527a-49fa-4a41-bbeb-c2a4b037e525. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f0ae26-1741-4e5b-b36c-ca31d3e2928c]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:19 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv
Sep 11 23:12:19 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:19 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv" returned: 0 in 0.624s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] GroupSnapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: creating.
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Group snapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: creating. {{(pid=88022) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Creating offline snapshot 91dfe71b-b690-4a05-86e4-5cd66289bcd6 of volume 0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:12:20 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv
Sep 11 23:12:20 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883afb4-ab40-40bc-ad79-5090d265fb55]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:20 devstack sudo[100007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140
Sep 11 23:12:20 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:20 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv" returned: 1 in 0.644s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_iljj2usv' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c89d5-43e7-47e9-afcd-070dad3f9b44]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:20 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140" returned: 0 in 0.478s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:20 devstack sudo[100016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 1G
Sep 11 23:12:20 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:20 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD
Sep 11 23:12:20 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:20 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] 414d8567-5d24-440f-be04-3f648fa33a01 was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:12:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:21 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525
Sep 11 23:12:21 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:21 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 1G" returned: 0 in 0.650s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0095c475-1d96-4cf8-b977-698c743cd140 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:21 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0095c475-1d96-4cf8-b977-698c743cd140 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6
Sep 11 23:12:21 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:21 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0095c475-1d96-4cf8-b977-698c743cd140 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:21 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6
Sep 11 23:12:21 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:21 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6" returned: 0 in 0.280s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:21 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info
Sep 11 23:12:21 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:22 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info" returned: 0 in 0.277s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:22 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 11 23:12:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:22 devstack sudo[100046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info
Sep 11 23:12:22 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:22 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.info" returned: 0 in 0.298s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-09d64f93-f19f-41e5-9a80-d5a6e667ea79 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: created successfully
Sep 11 23:12:23 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525" returned: 0 in 2.037s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_u7t_w_4hdevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:12:23 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Converted 112.00 MB image at 54.96 MB/s
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:23 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1G
Sep 11 23:12:23 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:23 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 1G" returned: 0 in 0.382s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Downloaded image 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume 352e527a-49fa-4a41-bbeb-c2a4b037e525 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 for user eed65226355a43b8a51f5cd9459f7688 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Marking volume 352e527a-49fa-4a41-bbeb-c2a4b037e525 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:12:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: deleting
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Copying metadata from image 414d8567-5d24-440f-be04-3f648fa33a01 to 352e527a-49fa-4a41-bbeb-c2a4b037e525. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Creating volume glance metadata for volume 352e527a-49fa-4a41-bbeb-c2a4b037e525 backed by image 414d8567-5d24-440f-be04-3f648fa33a01 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: deleting {{(pid=88022) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-91dfe71b-b690-4a05-86e4-5cd66289bcd6" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-91dfe71b-b690-4a05-86e4-5cd66289bcd6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Deleting offline snapshot 91dfe71b-b690-4a05-86e4-5cd66289bcd6 of volume 0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] snapshot_file for this snap is: volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[faedad41-b04e-4f30-b99e-2eaad5249815]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a7d341-a59b-4e22-85cc-a9113cd68cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352e527a-49fa-4a41-bbeb-c2a4b037e525', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6658b60>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f75155-6809-4d5b-bd24-e2c559b3bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:23 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Volume volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 (352e527a-49fa-4a41-bbeb-c2a4b037e525): created successfully
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f75155-6809-4d5b-bd24-e2c559b3bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:23 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Flow 'volume_create_manager' (e3360585-d578-4140-9b44-d61b61433402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7578e941-a1ff-4c7f-9940-e72da23465de tempest-VolumesExtendTest-651707849 None] Created volume successfully.
Sep 11 23:12:23 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6
Sep 11 23:12:23 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a36bd8-b923-4add-bb25-009537edaa38]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:24 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6" returned: 0 in 0.558s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0095c475-1d96-4cf8-b977-698c743cd140(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9992422-bdc4-4825-96c9-640f2e19d4f4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:24 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525
Sep 11 23:12:24 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:24 devstack sudo[100076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140
Sep 11 23:12:24 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:24 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 2G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:24 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140" returned: 0 in 0.379s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:24 devstack sudo[100087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6
Sep 11 23:12:24 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 2G" returned: 0 in 0.132s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.571s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10773f78-142b-4c9f-b7f9-6973efecc3d4 tempest-VolumesExtendTest-651707849 None] Extend volume completed successfully.
Sep 11 23:12:24 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:25 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6
Sep 11 23:12:25 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:25 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140.91dfe71b-b690-4a05-86e4-5cd66289bcd6" returned: 0 in 0.276s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-91dfe71b-b690-4a05-86e4-5cd66289bcd6" released by "_delete_snapshot" :: held 1.719s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" released by "delete_snapshot" :: held 1.752s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:25 devstack cinder-volume[88022]: WARNING cinder.quota [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-479657680 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-479657680, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:25 devstack cinder-volume[88022]: WARNING cinder.quota [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-479657680 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-479657680, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['345bc8ca-dd98-4d7f-b690-e91ec31b31e0', 'ffcb86ab-6fdd-4fb5-9083-b513a0895c77', 'd0fcb3bb-3f90-45f3-ba30-9d23ad6f6331', '9a8fb88d-6604-4e84-a978-8e520769c2d2'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-32698561-0d35-4779-abb1-5dc500f2ee44 tempest-GroupSnapshotsTest-1296371741 None] group_snapshot b4bd5286-6c11-46a5-b5b9-41b302ea0dde: deleted successfully
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-352e527a-49fa-4a41-bbeb-c2a4b037e525-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "cinder-352e527a-49fa-4a41-bbeb-c2a4b037e525-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-quobyte-352e527a-49fa-4a41-bbeb-c2a4b037e525" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-352e527a-49fa-4a41-bbeb-c2a4b037e525" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a61b0d-363d-4bda-8a82-42b7e7718916]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:25 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525
Sep 11 23:12:25 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:26 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525" returned: 0 in 0.427s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:26 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525
Sep 11 23:12:26 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfb2809-d276-46b8-ad06-5c482986d9f6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:26 devstack sudo[100104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140
Sep 11 23:12:26 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:26 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-352e527a-49fa-4a41-bbeb-c2a4b037e525" returned: 0 in 0.295s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-352e527a-49fa-4a41-bbeb-c2a4b037e525" released by "delete_volume" :: held 0.761s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Created reservations ['97d22af8-d504-4883-8308-0b9e5086c145', 'e3191057-f993-471c-906a-6060bea62af2', '1e693002-3456-493b-872b-2b5041a5e238', '6703c113-bfbb-41f9-aac7-771d28d19af6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:26 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:26 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:26 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140" returned: 0 in 0.456s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:26 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140
Sep 11 23:12:26 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:26 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.289s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Deleted volume successfully.
Sep 11 23:12:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-48bd64f9-e003-458d-8072-1fa9d8af4198 tempest-VolumesExtendTest-651707849 None] Lock "cinder-352e527a-49fa-4a41-bbeb-c2a4b037e525-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:27 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0095c475-1d96-4cf8-b977-698c743cd140" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Lock "cinder-quobyte-0095c475-1d96-4cf8-b977-698c743cd140" released by "delete_volume" :: held 0.842s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['b8aee666-72af-47c5-bc0e-495e279481e0'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:27 devstack cinder-volume[88022]: WARNING cinder.quota [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-479657680 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-479657680, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Created reservations ['e0e4d8ed-4e24-45a6-89ba-4d26742b157a', '0c056c35-9b9d-414f-a0ab-cebc680c80f6', '9a18cfc2-8a22-43bf-8360-7e5896b949f0', '32422b9b-0854-4959-972f-897ddaf9581e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:27 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:27 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Flow 'volume_create_manager' (6d34d111-7c0b-42aa-9d47-736848b9c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526d8ca-3bbe-4139-9124-5fcdcc15c939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526d8ca-3bbe-4139-9124-5fcdcc15c939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-39522991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66133a-6737-4487-b750-718cb713c3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b7af5c38a4fbcab6ff4717e917550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:27Z,use_quota=True,user_id='eed65226355a43b8a51f5cd9459f7688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40616e36-d1c4-4c2d-b07c-c4bc48c3a331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40616e36-d1c4-4c2d-b07c-c4bc48c3a331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da52d1c0-fd65-4d5b-88ed-b8b07de6b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da52d1c0-fd65-4d5b-88ed-b8b07de6b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a66133a-6737-4487-b750-718cb713c3e7', 'volume_name': 'volume-1a66133a-6737-4487-b750-718cb713c3e7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653352c6-8e50-40cd-a7c9-3e7afe51630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653352c6-8e50-40cd-a7c9-3e7afe51630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e207b8ee-10a7-4524-bf9f-352d8c54ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Volume 1a66133a-6737-4487-b750-718cb713c3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a66133a-6737-4487-b750-718cb713c3e7', 'volume_size': 1}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-39522991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66133a-6737-4487-b750-718cb713c3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b7af5c38a4fbcab6ff4717e917550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:27Z,use_quota=True,user_id='eed65226355a43b8a51f5cd9459f7688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Creating volume 1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:27 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 1073741824
Sep 11 23:12:27 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:27 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.342s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:27 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d8cdec22-8320-4929-945d-71ab669ef6ad tempest-GroupSnapshotsTest-1296371741 None] Delete group completed successfully.
Sep 11 23:12:28 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 1073741824" returned: 0 in 0.523s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:28 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:28 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:28 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e207b8ee-10a7-4524-bf9f-352d8c54ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a66133a-6737-4487-b750-718cb713c3e7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fb563-92ac-4c35-9e0e-1c0a9b31fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Volume volume-1a66133a-6737-4487-b750-718cb713c3e7 (1a66133a-6737-4487-b750-718cb713c3e7): created successfully
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6fb563-92ac-4c35-9e0e-1c0a9b31fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Flow 'volume_create_manager' (6d34d111-7c0b-42aa-9d47-736848b9c739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-648f5606-438a-40f5-8be4-e874970d60ea tempest-VolumesExtendTest-651707849 None] Created volume successfully.
Sep 11 23:12:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Creating offline snapshot dba23c44-7166-4b20-a3fd-3c5cf9186ffa of volume 1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:12:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae45bea-072d-4239-a01c-86c93b573ebe]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:29 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:29 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:30 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.420s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:30 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa 1G
Sep 11 23:12:30 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:30 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa 1G" returned: 0 in 0.527s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66133a-6737-4487-b750-718cb713c3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:30 devstack sudo[100155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66133a-6737-4487-b750-718cb713c3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa
Sep 11 23:12:30 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:31 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66133a-6737-4487-b750-718cb713c3e7 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa" returned: 0 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:31 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa is being set with open permissions: ugo+rw
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:31 devstack sudo[100161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa
Sep 11 23:12:31 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:31 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:31 devstack sudo[100164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info
Sep 11 23:12:31 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:31 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:31 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info is being set with open permissions: ugo+rw
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:31 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info
Sep 11 23:12:31 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:31 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.info" returned: 0 in 0.283s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1fed67d8-2453-41fe-a058-104942e9b169 tempest-VolumesExtendTest-651707849 None] Create snapshot completed successfully
Sep 11 23:12:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:32 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedec76e-4711-4d4a-bb66-2d09a03c7bce]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:33 devstack sudo[100170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:33 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:33 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.373s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa 2G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa 2G" returned: 0 in 0.124s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.538s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-faa89a7f-717c-45d8-ba7f-099e964c139b tempest-VolumesExtendTest-651707849 None] Extend volume completed successfully.
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-dba23c44-7166-4b20-a3fd-3c5cf9186ffa-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-dba23c44-7166-4b20-a3fd-3c5cf9186ffa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-quobyte-dba23c44-7166-4b20-a3fd-3c5cf9186ffa" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-dba23c44-7166-4b20-a3fd-3c5cf9186ffa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Deleting offline snapshot dba23c44-7166-4b20-a3fd-3c5cf9186ffa of volume 1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] snapshot_file for this snap is: volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57beffb-1aa6-496d-a4e0-bfa4bb762cd6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:34 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa
Sep 11 23:12:34 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:34 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa" returned: 0 in 0.447s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66133a-6737-4487-b750-718cb713c3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f041587-9b80-4395-9309-f128bd7d2581]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:35 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:35 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:35 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.432s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:35 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa
Sep 11 23:12:35 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:35 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa" returned: 0 in 0.424s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:35 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa
Sep 11 23:12:35 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:36 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7.dba23c44-7166-4b20-a3fd-3c5cf9186ffa" returned: 0 in 0.311s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=103,cinder:UPDATE=101,cinder:INSERT=34,cinder:DELETE=8 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-dba23c44-7166-4b20-a3fd-3c5cf9186ffa" released by "_delete_snapshot" :: held 1.759s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" released by "delete_snapshot" :: held 1.793s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Created reservations ['0709547d-51f2-41d4-bc4d-b1cd3eaaf67d', '3b2bb9ea-ba46-4027-996e-4c9a0c08c156', '16d832f6-91c4-4f9b-ba65-76b216a97041', 'e42c0811-9597-4e8e-86ae-1faad3d12182'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Delete snapshot completed successfully.
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b1771b30-295e-44a9-aae5-a0c39a46678f tempest-VolumesExtendTest-651707849 None] Lock "cinder-dba23c44-7166-4b20-a3fd-3c5cf9186ffa-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-1a66133a-6737-4487-b750-718cb713c3e7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "cinder-1a66133a-6737-4487-b750-718cb713c3e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Acquiring lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e73148-4b28-4426-8b1e-903dd6c3bc3a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:36 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:36 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:37 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.424s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:37 devstack sudo[100206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7
Sep 11 23:12:37 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:37 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1a66133a-6737-4487-b750-718cb713c3e7" returned: 0 in 0.248s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "cinder-quobyte-1a66133a-6737-4487-b750-718cb713c3e7" released by "delete_volume" :: held 0.746s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Created reservations ['eb2dd6f1-6da2-407f-9dcc-6faf6bf96659', '5abfb03a-3811-491e-a19b-f84982d5b1d4', '665567da-b10d-4cb0-bc4e-d34d61aec253', 'f246850a-9ff5-4519-a9ce-308abc11a8c8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:37 devstack sudo[100209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:37 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:37 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.270s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Deleted volume successfully.
Sep 11 23:12:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-46c626f9-7be3-4c70-a6f6-ea1f234af618 tempest-VolumesExtendTest-651707849 None] Lock "cinder-1a66133a-6737-4487-b750-718cb713c3e7-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-08179904-5091-485a-9395-eedd5da4d6e7 req-f404857b-fefb-49ef-972a-dd900470dfdb tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-08179904-5091-485a-9395-eedd5da4d6e7 req-f404857b-fefb-49ef-972a-dd900470dfdb tempest-TestStampPattern-1099253805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-08179904-5091-485a-9395-eedd5da4d6e7 req-f404857b-fefb-49ef-972a-dd900470dfdb tempest-TestStampPattern-1099253805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:40 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=117,cinder:UPDATE=112,cinder:INSERT=25 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:12:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-08179904-5091-485a-9395-eedd5da4d6e7 req-f404857b-fefb-49ef-972a-dd900470dfdb tempest-TestStampPattern-1099253805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-e91ecb4b-f268-4854-8308-db61b021a55c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd39d0f3-7127-4f06-80e9-259e4dde2899', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:12:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-08179904-5091-485a-9395-eedd5da4d6e7 req-f404857b-fefb-49ef-972a-dd900470dfdb tempest-TestStampPattern-1099253805 None] attachment_update completed successfully.
Sep 11 23:12:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-fb55902d-b1c1-4f36-9afc-36bf0dee1b42 req-466506a6-b388-4f2b-afde-f9f48a38a765 tempest-TestStampPattern-1099253805 None] Terminate volume connection completed successfully.
Sep 11 23:12:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-fb55902d-b1c1-4f36-9afc-36bf0dee1b42 req-466506a6-b388-4f2b-afde-f9f48a38a765 tempest-TestStampPattern-1099253805 None] Deleting attachment bd39d0f3-7127-4f06-80e9-259e4dde2899. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:46 devstack sudo[100255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:46 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:46 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Creating offline snapshot af909496-0dc2-4868-a985-9d075bc59116 of volume e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08b31b0-5450-4789-8760-e95869d0eceb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:46 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:12:46 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:47 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:47 devstack sudo[100268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 1G
Sep 11 23:12:47 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:47 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 1G" returned: 0 in 0.624s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91ecb4b-f268-4854-8308-db61b021a55c -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:47 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91ecb4b-f268-4854-8308-db61b021a55c -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:12:47 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:48 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e91ecb4b-f268-4854-8308-db61b021a55c -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.444s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:48 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 is being set with open permissions: ugo+rw
Sep 11 23:12:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:48 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:12:48 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:48 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.345s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:48 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info
Sep 11 23:12:48 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:49 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:49 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info is being set with open permissions: ugo+rw
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:49 devstack sudo[100287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info
Sep 11 23:12:49 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Flow 'volume_create_manager' (78b43c42-b75b-49c4-af85-b1740634a065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e18a61-728b-45a7-a2fb-824ffb5a56a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e18a61-728b-45a7-a2fb-824ffb5a56a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1925358751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20256b9b-c37a-4aa7-a2f0-bf7491a70dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74feaf3d96ca4c18965a0e420749b161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:49Z,use_quota=True,user_id='627b383501384b2f95a6e64d06499c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68cdc2e6-667d-4fc1-99f2-cc805eb69311),volume_type_id=68cdc2e6-667d-4fc1-99f2-cc805eb69311)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078acc00-4dfa-46a8-9545-7347a16a2bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078acc00-4dfa-46a8-9545-7347a16a2bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0058c773-2c6d-4271-aa1a-ad18678235d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0058c773-2c6d-4271-aa1a-ad18678235d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20256b9b-c37a-4aa7-a2f0-bf7491a70dec', 'volume_name': 'volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf8be30-d558-4234-b2b9-69afd1a6fb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf8be30-d558-4234-b2b9-69afd1a6fb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca8d8f1-37a8-46b4-a1a8-0428b45ac0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:49 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Volume 20256b9b-c37a-4aa7-a2f0-bf7491a70dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec', 'volume_size': 1}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:49 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.info" returned: 0 in 0.543s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.984s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1925358751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20256b9b-c37a-4aa7-a2f0-bf7491a70dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74feaf3d96ca4c18965a0e420749b161',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:49Z,use_quota=True,user_id='627b383501384b2f95a6e64d06499c0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68cdc2e6-667d-4fc1-99f2-cc805eb69311),volume_type_id=68cdc2e6-667d-4fc1-99f2-cc805eb69311)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Creating volume 20256b9b-c37a-4aa7-a2f0-bf7491a70dec {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:49 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:49 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec 1073741824
Sep 11 23:12:49 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-753a9f77-8e8e-43aa-b9fc-7a732a555af2 tempest-TestStampPattern-1099253805 None] Create snapshot completed successfully
Sep 11 23:12:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-cca5b58c-e2b3-42ec-971a-d74b57da67b2 req-e5d93e53-f5c1-4b20-b197-9f612a44efd4 tempest-TestMinimumBasicScenario-1391036782 None] Terminate volume connection completed successfully.
Sep 11 23:12:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-cca5b58c-e2b3-42ec-971a-d74b57da67b2 req-e5d93e53-f5c1-4b20-b197-9f612a44efd4 tempest-TestMinimumBasicScenario-1391036782 None] Deleting attachment 46130550-6917-4f01-97d9-9cf37c8ccf8d. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:12:50 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec 1073741824" returned: 0 in 0.775s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:50 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec
Sep 11 23:12:50 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "cinder-158d64e3-27b4-408e-ad0a-93770f8feff3-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "cinder-158d64e3-27b4-408e-ad0a-93770f8feff3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:51 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "cinder-quobyte-158d64e3-27b4-408e-ad0a-93770f8feff3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca8d8f1-37a8-46b4-a1a8-0428b45ac0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d079467d-eaa8-4f24-9681-97116271e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "cinder-quobyte-158d64e3-27b4-408e-ad0a-93770f8feff3" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Volume volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec (20256b9b-c37a-4aa7-a2f0-bf7491a70dec): created successfully
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d079467d-eaa8-4f24-9681-97116271e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Flow 'volume_create_manager' (78b43c42-b75b-49c4-af85-b1740634a065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c44b3-5848-4eea-b165-2bd9f4196a7b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9ca2236e-2f5e-47ef-bec2-ce6e64b24ed7 tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Created volume successfully.
Sep 11 23:12:51 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3
Sep 11 23:12:51 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:51 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3" returned: 0 in 0.528s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:51 devstack sudo[100309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3
Sep 11 23:12:51 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:52 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:52 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:52 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-158d64e3-27b4-408e-ad0a-93770f8feff3" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "cinder-quobyte-158d64e3-27b4-408e-ad0a-93770f8feff3" released by "delete_volume" :: held 0.996s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Created reservations ['470238d1-abc0-415c-b930-4582c6eb6523', 'f158c507-eacc-467d-80d2-55c6928ee0ed', '7cd1ec78-d5a1-432f-a582-f8c093410f0c', '418fe631-03f1-428c-9e55-a0394b63ccbb'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:52 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:52 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:52 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4045a676-7ac1-4c2a-9c0a-c55f265d634a tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Retype volume completed successfully.
Sep 11 23:12:52 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.330s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Deleted volume successfully.
Sep 11 23:12:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-205a45ee-c94b-4fdf-acb7-7efbc9ccb908 tempest-TestMinimumBasicScenario-1391036782 None] Lock "cinder-158d64e3-27b4-408e-ad0a-93770f8feff3-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "cinder-20256b9b-c37a-4aa7-a2f0-bf7491a70dec-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "cinder-20256b9b-c37a-4aa7-a2f0-bf7491a70dec-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "cinder-quobyte-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "cinder-quobyte-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec264d5-9c1e-4bbf-a13d-0683d960fc98]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:53 devstack sudo[100339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec
Sep 11 23:12:53 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:53 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" returned: 0 in 0.579s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:53 devstack sudo[100356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec
Sep 11 23:12:53 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:54 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" returned: 0 in 0.445s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "cinder-quobyte-20256b9b-c37a-4aa7-a2f0-bf7491a70dec" released by "delete_volume" :: held 1.111s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:54 devstack cinder-volume[88022]: WARNING cinder.quota [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:54 devstack cinder-volume[88022]: WARNING cinder.quota [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Created reservations ['b89bf6d0-4680-46f1-a0fb-13f2d14f1039', 'c6a9da54-c645-4afb-a972-176c32c15dd5', '2de4fe90-6c49-4b40-b8f2-590a62a548b1', '869df2a7-46ac-45d8-a58e-ec304d415d32'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:54 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:12:54 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:55 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:55 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:12:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Deleted volume successfully.
Sep 11 23:12:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc09ab81-864d-4110-a950-22ec6c9bbb4e tempest-VolumeRetypeWithoutMigrationTest-382926374 None] Lock "cinder-20256b9b-c37a-4aa7-a2f0-bf7491a70dec-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (068de3c6-d17e-45d2-925a-cbd35c274d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e43d51-4cf3-4797-ba64-e86c65602450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e43d51-4cf3-4797-ba64-e86c65602450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1242451178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ade5613-7796-4ba5-a3a8-73f04ce5e272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:58Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657c71d4-92c9-45ee-ade7-6c0a065cac39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657c71d4-92c9-45ee-ade7-6c0a065cac39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13893447-c6b3-4841-80d7-a946776ea695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13893447-c6b3-4841-80d7-a946776ea695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ade5613-7796-4ba5-a3a8-73f04ce5e272', 'volume_name': 'volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cfda2d-6edc-40fa-9a8c-c9e42da64a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cfda2d-6edc-40fa-9a8c-c9e42da64a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fcbd3-ae10-4d09-9fb9-33b7fd25342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:58 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume 0ade5613-7796-4ba5-a3a8-73f04ce5e272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272', 'volume_size': 1}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1242451178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ade5613-7796-4ba5-a3a8-73f04ce5e272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:12:58Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating volume 0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:12:58 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:58 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 1073741824
Sep 11 23:12:58 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:58 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 1073741824" returned: 0 in 0.711s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:12:58 devstack sudo[100397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272
Sep 11 23:12:58 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:12:59 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272" returned: 0 in 0.294s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (628fcbd3-ae10-4d09-9fb9-33b7fd25342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d692d1b-8d98-4150-87e5-68418fdc468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 (0ade5613-7796-4ba5-a3a8-73f04ce5e272): created successfully
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d692d1b-8d98-4150-87e5-68418fdc468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (068de3c6-d17e-45d2-925a-cbd35c274d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e0de00fc-c90d-4ea4-b786-61f5e57362f3 tempest-VolumesSnapshotTestJSON-1232924101 None] Created volume successfully.
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Flow 'volume_create_manager' (031f67bc-04fd-4dcf-b03a-f0ce91a64602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c0cad3-80fa-4cb0-baed-7ab281765ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c0cad3-80fa-4cb0-baed-7ab281765ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1023002335',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1025b5a1-c6a8-4033-a975-6924524940df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6017d90bcd964a179e7dab7dc8452de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=af909496-0dc2-4868-a985-9d075bc59116,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:00Z,use_quota=True,user_id='1f095a398103404ba9758a88c26c5a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605b6445-4422-4146-9906-b2d4db00ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605b6445-4422-4146-9906-b2d4db00ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d9a01e-6621-4738-a071-eb0e8c3a2d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d9a01e-6621-4738-a071-eb0e8c3a2d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1025b5a1-c6a8-4033-a975-6924524940df', 'volume_name': 'volume-1025b5a1-c6a8-4033-a975-6924524940df', 'volume_size': 1, 'snapshot_id': 'af909496-0dc2-4868-a985-9d075bc59116'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4e4d5d-d59e-4bd9-9e38-794571585ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4e4d5d-d59e-4bd9-9e38-794571585ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:12:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0c3e44-5299-4e61-9757-15126af68dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Volume 1025b5a1-c6a8-4033-a975-6924524940df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1025b5a1-c6a8-4033-a975-6924524940df', 'volume_size': 1, 'snapshot_id': 'af909496-0dc2-4868-a985-9d075bc59116'}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116-1025b5a1-c6a8-4033-a975-6924524940df" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116-1025b5a1-c6a8-4033-a975-6924524940df" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Creating volume 1025b5a1-c6a8-4033-a975-6924524940df from snapshot af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] snapshot: af909496-0dc2-4868-a985-9d075bc59116, volume: 1025b5a1-c6a8-4033-a975-6924524940df,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1b4565-b65e-4719-9e1e-dad021e248c2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:00 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:13:00 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:00 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.547s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91ecb4b-f268-4854-8308-db61b021a55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0354d76-757a-48d5-8aee-7c82fb109e72]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:00 devstack sudo[100406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:13:00 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:01 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.496s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:13:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:13:01 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:13:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:01 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df
Sep 11 23:13:01 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:07 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df" returned: 0 in 6.625s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:07 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:13:07 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Converted 1024.00 MB image at 154.28 MB/s
Sep 11 23:13:07 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df is being set with open permissions: ugo+rw
Sep 11 23:13:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:07 devstack sudo[100429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df
Sep 11 23:13:07 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:08 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df" returned: 0 in 0.500s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" released by "_copy_volume_from_snapshot" :: held 8.298s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116-1025b5a1-c6a8-4033-a975-6924524940df" released by "_create_volume_from_snapshot" :: held 8.406s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.429s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.787s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating offline snapshot 0904c7f0-077f-40c0-8631-c3c60280acb8 of volume 0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0c3e44-5299-4e61-9757-15126af68dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1025b5a1-c6a8-4033-a975-6924524940df', 'volume_size': 1, 'snapshot_id': 'af909496-0dc2-4868-a985-9d075bc59116'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7783bf-8f10-4397-bb8a-8f132b7b681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Volume volume-1025b5a1-c6a8-4033-a975-6924524940df (1025b5a1-c6a8-4033-a975-6924524940df): created successfully
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7783bf-8f10-4397-bb8a-8f132b7b681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Flow 'volume_create_manager' (031f67bc-04fd-4dcf-b03a-f0ce91a64602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71748d-afff-4dc2-97e4-a6948c5b1de8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-67fd2bb3-9767-41bb-af6c-44b7ab420ee2 tempest-TestStampPattern-1099253805 None] Created volume successfully.
Sep 11 23:13:08 devstack sudo[100466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272
Sep 11 23:13:08 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:09 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272" returned: 0 in 0.748s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:09 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 1G
Sep 11 23:13:09 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:09 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 1G" returned: 0 in 0.644s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:10 devstack sudo[100492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8
Sep 11 23:13:10 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:10 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8" returned: 0 in 0.451s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:10 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 is being set with open permissions: ugo+rw
Sep 11 23:13:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:10 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8
Sep 11 23:13:10 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:10 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:10 devstack sudo[100514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info
Sep 11 23:13:10 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:11 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:11 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info is being set with open permissions: ugo+rw
Sep 11 23:13:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:11 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info
Sep 11 23:13:11 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:11 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.info" returned: 0 in 0.295s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bb2fffa9-49db-4097-a4fb-f21988155393 tempest-VolumesSnapshotTestJSON-1232924101 None] Create snapshot completed successfully
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-0904c7f0-077f-40c0-8631-c3c60280acb8-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-0904c7f0-077f-40c0-8631-c3c60280acb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-0904c7f0-077f-40c0-8631-c3c60280acb8" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0904c7f0-077f-40c0-8631-c3c60280acb8" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Deleting offline snapshot 0904c7f0-077f-40c0-8631-c3c60280acb8 of volume 0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] snapshot_file for this snap is: volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40d4d61-29d3-4fe5-a7a8-07852170efb1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:13 devstack sudo[100521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8
Sep 11 23:13:13 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:13 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8" returned: 0 in 0.554s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:13 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[707d11b5-2f80-43fd-885e-b9f54e7475ec]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:13 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272
Sep 11 23:13:13 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:14 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272" returned: 0 in 0.627s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:14 devstack sudo[100569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8
Sep 11 23:13:14 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:14 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8" returned: 0 in 0.793s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:15 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8
Sep 11 23:13:15 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:15 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272.0904c7f0-077f-40c0-8631-c3c60280acb8" returned: 0 in 0.459s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0904c7f0-077f-40c0-8631-c3c60280acb8" released by "_delete_snapshot" :: held 2.670s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" released by "delete_snapshot" :: held 2.723s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:15 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['f368033b-bc50-4d8f-811e-d4b8c5ed5d0a', 'bbc55613-b075-440f-b133-de120e73efc1', 'f013bc62-970b-4a9a-81b9-cf04ca13710f', '01c2394a-e2e5-4fcd-8f9f-7ffff7c7ebb0'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Delete snapshot completed successfully.
Sep 11 23:13:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9d571cb5-22d4-48b8-90b8-ad78d9258648 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-0904c7f0-077f-40c0-8631-c3c60280acb8-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (54bf66d5-e2ea-4e52-80e5-d5f91f5f4415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb5ddb1-aab0-423d-94eb-e4e7fad435ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb5ddb1-aab0-423d-94eb-e4e7fad435ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903850282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1564aae3-8916-4c02-b9b8-86ebcaa2e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:17Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3d28b-39a6-40d4-96e0-9cd3b90a3a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4f3d28b-39a6-40d4-96e0-9cd3b90a3a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a2272-e896-429d-b7bb-17c0af979cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4a2272-e896-429d-b7bb-17c0af979cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1564aae3-8916-4c02-b9b8-86ebcaa2e75e', 'volume_name': 'volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc6d39a-e3d7-437a-a7a0-0a6c58a1ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc6d39a-e3d7-437a-a7a0-0a6c58a1ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1782b246-fbf2-4222-be26-3e899a8402d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume 1564aae3-8916-4c02-b9b8-86ebcaa2e75e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e', 'volume_size': 1}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-903850282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1564aae3-8916-4c02-b9b8-86ebcaa2e75e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:17Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating volume 1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:17 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:17 devstack sudo[100582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e 1073741824
Sep 11 23:13:17 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Flow 'volume_create_manager' (87cacf7c-c0c3-4142-8ccd-97b78c0e31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b056eb03-85d6-48c9-80ed-7516cfcb04a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b056eb03-85d6-48c9-80ed-7516cfcb04a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1820135991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41f0200-2f1d-4430-a5e9-aef8c8b4820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364740938d524eaaa1d322f9d73e1033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:18Z,use_quota=True,user_id='b213e0c4875347cf9da2953a699f2625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0208e6-460f-41d9-a061-809dc8ace288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0208e6-460f-41d9-a061-809dc8ace288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419674ec-bc9a-4b15-8886-a331122a1667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419674ec-bc9a-4b15-8886-a331122a1667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41f0200-2f1d-4430-a5e9-aef8c8b4820e', 'volume_name': 'volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d1b976-f848-42bb-acf8-79b95318df78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d1b976-f848-42bb-acf8-79b95318df78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb39a766-e431-4864-a16c-cc6f89e945e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:17 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Volume f41f0200-2f1d-4430-a5e9-aef8c8b4820e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e', 'volume_size': 1}
Sep 11 23:13:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:18 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e 1073741824" returned: 0 in 0.841s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:18 devstack sudo[100588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:18 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 0.453s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:13:18 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1820135991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41f0200-2f1d-4430-a5e9-aef8c8b4820e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364740938d524eaaa1d322f9d73e1033',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:18Z,use_quota=True,user_id='b213e0c4875347cf9da2953a699f2625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Creating volume f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:18 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:18 devstack sudo[100591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e 1073741824
Sep 11 23:13:18 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1782b246-fbf2-4222-be26-3e899a8402d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42742ea-9ca0-4a9d-8bd4-58299d16d6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e (1564aae3-8916-4c02-b9b8-86ebcaa2e75e): created successfully
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42742ea-9ca0-4a9d-8bd4-58299d16d6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (54bf66d5-e2ea-4e52-80e5-d5f91f5f4415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-42b3709e-9c89-4242-804c-011e77cb4ab9 tempest-VolumesSnapshotTestJSON-1232924101 None] Created volume successfully.
Sep 11 23:13:19 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e 1073741824" returned: 0 in 0.928s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:19 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e
Sep 11 23:13:19 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:20 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" returned: 0 in 0.440s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.487s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb39a766-e431-4864-a16c-cc6f89e945e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e531378-c390-414f-b2a6-7d0df45dc322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Creating offline snapshot a350d773-c30d-45fc-bf1c-a6bfa66af0a3 of volume 1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Volume volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e (f41f0200-2f1d-4430-a5e9-aef8c8b4820e): created successfully
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e531378-c390-414f-b2a6-7d0df45dc322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Flow 'volume_create_manager' (87cacf7c-c0c3-4142-8ccd-97b78c0e31b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edde4a5-4e49-4201-a2a2-886526e2911e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-deb8b019-ba65-4f5c-9829-b7640f3f8077 tempest-SnapshotMetadataTestJSON-946719185 None] Created volume successfully.
Sep 11 23:13:20 devstack sudo[100599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:20 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:21 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 0.754s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:21 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 1G
Sep 11 23:13:21 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:21 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 1G" returned: 0 in 0.593s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:21 devstack sudo[100614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:21 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Flow 'volume_create_manager' (b51ec1be-2821-4f15-a9cd-161ca4297844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c261a-2321-4d8b-88cf-c8f09924a96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39c261a-2321-4d8b-88cf-c8f09924a96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2091658317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0edec8f-6494-4c52-a2a7-68ff54740333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ef00c43100478299bcc6c279e7f05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:22Z,use_quota=True,user_id='acea116c28bb4d6b98e694b2bd2673c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51160f6c-3b2b-430a-9b36-761d1edce1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51160f6c-3b2b-430a-9b36-761d1edce1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff261d-8549-4575-868a-edf44954d260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff261d-8549-4575-868a-edf44954d260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0edec8f-6494-4c52-a2a7-68ff54740333', 'volume_name': 'volume-d0edec8f-6494-4c52-a2a7-68ff54740333', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb11744-025e-4de5-bfce-62e32c5c2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb11744-025e-4de5-bfce-62e32c5c2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c7b67-0d47-4143-8ba2-640850ad4670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:21 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Volume d0edec8f-6494-4c52-a2a7-68ff54740333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0edec8f-6494-4c52-a2a7-68ff54740333', 'volume_size': 1}
Sep 11 23:13:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:22 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:22 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 is being set with open permissions: ugo+rw
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:22 devstack sudo[100619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:22 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:22 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:22 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info
Sep 11 23:13:22 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:22 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:22 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info is being set with open permissions: ugo+rw
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:22 devstack sudo[100625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info
Sep 11 23:13:22 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:22 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.info" returned: 0 in 0.241s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.638s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.136s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Creating offline snapshot e95db859-8735-4f5b-8390-ccb245283fba of volume f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df8c85-7d14-42fe-b6ea-d8ee6c4295b2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-553bd9cb-3811-4b33-beed-0a0462e8805e tempest-VolumesSnapshotTestJSON-1232924101 None] Create snapshot completed successfully
Sep 11 23:13:23 devstack sudo[100628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e
Sep 11 23:13:23 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:23 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:23 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba 1G
Sep 11 23:13:23 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:23 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba 1G" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:23 devstack sudo[100639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba
Sep 11 23:13:23 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:23 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba" returned: 0 in 0.294s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:23 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba is being set with open permissions: ugo+rw
Sep 11 23:13:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:23 devstack sudo[100644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba
Sep 11 23:13:24 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:24 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:24 devstack sudo[100653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info
Sep 11 23:13:24 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (192cb97b-658b-468f-a459-0c47cb4af129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:24 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70651f6-3668-4e38-b6ff-ff12d5915767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info" returned: 0 in 0.329s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:24 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info is being set with open permissions: ugo+rw
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:24 devstack sudo[100656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info
Sep 11 23:13:24 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d70651f6-3668-4e38-b6ff-ff12d5915767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-935116499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8774b3f-3c48-463b-ae6b-2684d8175ee6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a350d773-c30d-45fc-bf1c-a6bfa66af0a3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:25Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863656b1-ca0a-4282-8b08-ca5408d93a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863656b1-ca0a-4282-8b08-ca5408d93a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e64ff3-8c00-422e-982f-f5320886cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e64ff3-8c00-422e-982f-f5320886cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8774b3f-3c48-463b-ae6b-2684d8175ee6', 'volume_name': 'volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6', 'volume_size': 2, 'snapshot_id': 'a350d773-c30d-45fc-bf1c-a6bfa66af0a3'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c6ac08-57fd-47f6-851b-c8bb809c4118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c6ac08-57fd-47f6-851b-c8bb809c4118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498cb566-c205-4b86-b8a2-8597cb4aab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:24 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume f8774b3f-3c48-463b-ae6b-2684d8175ee6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6', 'volume_size': 2, 'snapshot_id': 'a350d773-c30d-45fc-bf1c-a6bfa66af0a3'}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:24 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.info" returned: 0 in 0.257s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.123s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2091658317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0edec8f-6494-4c52-a2a7-68ff54740333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ef00c43100478299bcc6c279e7f05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:22Z,use_quota=True,user_id='acea116c28bb4d6b98e694b2bd2673c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Creating volume d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:24 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:13:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:24 devstack sudo[100659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 1073741824
Sep 11 23:13:24 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-21a25228-8764-485f-854a-33a5af1a2db9 tempest-SnapshotMetadataTestJSON-946719185 None] Create snapshot completed successfully
Sep 11 23:13:25 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 1073741824" returned: 0 in 0.460s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:25 devstack sudo[100666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:25 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:25 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.046s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-f8774b3f-3c48-463b-ae6b-2684d8175ee6" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7c7b67-0d47-4143-8ba2-640850ad4670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0edec8f-6494-4c52-a2a7-68ff54740333', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952641b3-71e6-473f-9b15-bc8e8b9ccff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-f8774b3f-3c48-463b-ae6b-2684d8175ee6" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating volume f8774b3f-3c48-463b-ae6b-2684d8175ee6 from snapshot a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Volume volume-d0edec8f-6494-4c52-a2a7-68ff54740333 (d0edec8f-6494-4c52-a2a7-68ff54740333): created successfully
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952641b3-71e6-473f-9b15-bc8e8b9ccff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Flow 'volume_create_manager' (b51ec1be-2821-4f15-a9cd-161ca4297844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] snapshot: a350d773-c30d-45fc-bf1c-a6bfa66af0a3, volume: f8774b3f-3c48-463b-ae6b-2684d8175ee6,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:13:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f81e795b-b0f1-4047-8e38-c4e1f0521030 tempest-VolumeDependencyTests-401730106 None] Created volume successfully.
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f436c90-da73-4acb-8d0b-613d64d349e4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:26 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:26 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "cinder-e95db859-8735-4f5b-8390-ccb245283fba-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-e95db859-8735-4f5b-8390-ccb245283fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:26 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.452s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "cinder-quobyte-e95db859-8735-4f5b-8390-ccb245283fba" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-e95db859-8735-4f5b-8390-ccb245283fba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Deleting offline snapshot e95db859-8735-4f5b-8390-ccb245283fba of volume f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] snapshot_file for this snap is: volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc526bd-cf68-4de6-9254-586ab752de2d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb0b6a-1051-44d8-9593-e925e0f93481]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:26 devstack sudo[100674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:26 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:26 devstack sudo[100675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba
Sep 11 23:13:26 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:27 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 0.562s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:27 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6
Sep 11 23:13:27 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:27 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba" returned: 0 in 0.647s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[16adb767-52ba-4038-b2b7-bb6fed854720]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:27 devstack sudo[100686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e
Sep 11 23:13:27 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:27 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" returned: 0 in 0.574s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:27 devstack sudo[100701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba
Sep 11 23:13:27 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:28 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba" returned: 0 in 1.261s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:29 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba
Sep 11 23:13:29 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:29 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e.e95db859-8735-4f5b-8390-ccb245283fba" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-e95db859-8735-4f5b-8390-ccb245283fba" released by "_delete_snapshot" :: held 3.006s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" released by "delete_snapshot" :: held 3.032s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Created reservations ['41351f7b-2023-4e19-b4bf-47d04f397325', 'bf5fb140-9e05-4434-a2cd-b323d2058ca3', 'cf699132-1146-4ab2-bcfa-8ca1870613f6', 'ef931481-cb04-483b-9f79-2ac9baf8d12e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Delete snapshot completed successfully.
Sep 11 23:13:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cc652110-16da-4cda-8e71-67e9dd204866 tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-e95db859-8735-4f5b-8390-ccb245283fba-delete_snapshot" released by "delete_snapshot" :: held 3.412s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "cinder-f41f0200-2f1d-4430-a5e9-aef8c8b4820e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-f41f0200-2f1d-4430-a5e9-aef8c8b4820e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26921281-f503-4ad5-9d0d-9cd0fd44a4af]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:31 devstack sudo[100719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e
Sep 11 23:13:31 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:31 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" returned: 0 in 0.648s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:31 devstack sudo[100724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e
Sep 11 23:13:31 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:31 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6" returned: 0 in 4.843s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:13:31 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Converted 1024.00 MB image at 211.40 MB/s
Sep 11 23:13:31 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 is being set with open permissions: ugo+rw
Sep 11 23:13:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:31 devstack sudo[100726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6
Sep 11 23:13:31 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:32 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-quobyte-f41f0200-2f1d-4430-a5e9-aef8c8b4820e" released by "delete_volume" :: held 1.036s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:32 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" released by "_copy_volume_from_snapshot" :: held 6.218s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Created reservations ['15d2cda1-18e7-4050-9388-d1367a4a9035', '2fafe128-f63f-474a-846f-0cee3bb9f9ca', '9939b553-bade-4651-8814-c87296ed70a6', '8621660e-dad9-491e-942c-66d839230a7d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-f8774b3f-3c48-463b-ae6b-2684d8175ee6" released by "_create_volume_from_snapshot" :: held 6.310s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.366s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.220s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Creating offline snapshot 87e9de2b-83fe-4472-b493-fd10222d17e3 of volume d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498cb566-c205-4b86-b8a2-8597cb4aab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6', 'volume_size': 2, 'snapshot_id': 'a350d773-c30d-45fc-bf1c-a6bfa66af0a3'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f97474-4ef1-499c-b1ad-db33605e165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc4a6a3-5be9-4641-bf31-5d07cd41a589]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 (f8774b3f-3c48-463b-ae6b-2684d8175ee6): created successfully
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f97474-4ef1-499c-b1ad-db33605e165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (192cb97b-658b-468f-a459-0c47cb4af129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fadb8d61-5ac0-4400-a111-2a371ae2ec84 tempest-VolumesSnapshotTestJSON-1232924101 None] Created volume successfully.
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:32 devstack sudo[100731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:32 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:32 devstack sudo[100730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:32 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:32 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Deleted volume successfully.
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8328c584-223a-4fe5-9dba-7feb488d425e tempest-SnapshotMetadataTestJSON-946719185 None] Lock "cinder-f41f0200-2f1d-4430-a5e9-aef8c8b4820e-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:32 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.380s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:32 devstack sudo[100738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 1G
Sep 11 23:13:32 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:32 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 1G" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0edec8f-6494-4c52-a2a7-68ff54740333 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:33 devstack sudo[100743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0edec8f-6494-4c52-a2a7-68ff54740333 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:33 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:33 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0edec8f-6494-4c52-a2a7-68ff54740333 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:33 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 is being set with open permissions: ugo+rw
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:33 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:33 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-f8774b3f-3c48-463b-ae6b-2684d8175ee6-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-f8774b3f-3c48-463b-ae6b-2684d8175ee6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:33 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.311s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[690279b6-6074-4460-b605-998203a7a662]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:33 devstack sudo[100753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info
Sep 11 23:13:33 devstack sudo[100753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:33 devstack sudo[100752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6
Sep 11 23:13:33 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:33 devstack sudo[100753]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info" returned: 0 in 0.270s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:33 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info is being set with open permissions: ugo+rw
Sep 11 23:13:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:33 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info
Sep 11 23:13:33 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:34 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:34 devstack sudo[100762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6
Sep 11 23:13:34 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:34 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.info" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c82e58e9-3331-4d53-9b0a-a3dda55641fa tempest-VolumeDependencyTests-401730106 None] Create snapshot completed successfully
Sep 11 23:13:34 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f8774b3f-3c48-463b-ae6b-2684d8175ee6" returned: 0 in 0.300s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-f8774b3f-3c48-463b-ae6b-2684d8175ee6" released by "delete_volume" :: held 0.747s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['9af9f045-421a-4373-a18d-58eade946f55', '9cab3503-bfe2-49b4-8d62-eac539a404db', '307eb88b-928f-433e-ad64-bfc591a04072', '8a1b2718-b78d-4762-99b9-1341eb1f2af2'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:34 devstack sudo[100767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:34 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Deleting offline snapshot a350d773-c30d-45fc-bf1c-a6bfa66af0a3 of volume 1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:34 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] snapshot_file for this snap is: volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.345s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Deleted volume successfully.
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77fe96-3f07-4d5b-8c87-58f7315e50c6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4bfd7530-9037-4d27-b998-bfa2175aca03 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-f8774b3f-3c48-463b-ae6b-2684d8175ee6-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:35 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:35 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Flow 'volume_create_manager' (19496d80-b3ab-428a-af87-706b39351856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e1120-b678-44d4-a563-eb23904753dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d43e1120-b678-44d4-a563-eb23904753dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1118339482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728e850a-1ea2-40b0-b524-4aa5e64a21a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71ef00c43100478299bcc6c279e7f05d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87e9de2b-83fe-4472-b493-fd10222d17e3,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:35Z,use_quota=True,user_id='acea116c28bb4d6b98e694b2bd2673c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808a619-2ac5-46cf-858a-f5d529ae3605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4808a619-2ac5-46cf-858a-f5d529ae3605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4e2a8d-d744-4fd3-be03-9fcf2b32b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4e2a8d-d744-4fd3-be03-9fcf2b32b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '728e850a-1ea2-40b0-b524-4aa5e64a21a7', 'volume_name': 'volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7', 'volume_size': 1, 'snapshot_id': '87e9de2b-83fe-4472-b493-fd10222d17e3'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910c78e-1897-4ad3-89aa-550b7b119816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b910c78e-1897-4ad3-89aa-550b7b119816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130d2125-773f-4be4-8592-0c5d267633ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Volume 728e850a-1ea2-40b0-b524-4aa5e64a21a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7', 'volume_size': 1, 'snapshot_id': '87e9de2b-83fe-4472-b493-fd10222d17e3'}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3-728e850a-1ea2-40b0-b524-4aa5e64a21a7" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3-728e850a-1ea2-40b0-b524-4aa5e64a21a7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Creating volume 728e850a-1ea2-40b0-b524-4aa5e64a21a7 from snapshot 87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] snapshot: 87e9de2b-83fe-4472-b493-fd10222d17e3, volume: 728e850a-1ea2-40b0-b524-4aa5e64a21a7,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52763c-aa06-4e48-aea4-779671e88f8e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:35 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb3324-c340-4713-baa3-92c112face7a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:35 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:35 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:35 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:35 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:35 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.379s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0edec8f-6494-4c52-a2a7-68ff54740333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b58fe-4155-433b-adcf-4f24e262fde5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:35 devstack sudo[100785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:35 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:35 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 0.556s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:35 devstack sudo[100788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:35 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:36 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.426s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:36 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7
Sep 11 23:13:36 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:36 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.369s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:36 devstack sudo[100798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3
Sep 11 23:13:36 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:36 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e.a350d773-c30d-45fc-bf1c-a6bfa66af0a3" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=110,cinder:INSERT=21,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-a350d773-c30d-45fc-bf1c-a6bfa66af0a3" released by "_delete_snapshot" :: held 1.831s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" released by "delete_snapshot" :: held 1.875s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['e712bffc-20b7-454a-8e1a-ae3455f481f5', '5b43cd28-f3e5-4f22-ae3f-415fe642b53f', '2464ea54-422e-4afa-ad0f-79a5e71b7661', 'b8ab7376-1d10-4b85-94fc-32effc907240'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Delete snapshot completed successfully.
Sep 11 23:13:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6ab8ae17-ea4a-4ce2-851f-b66c31dc4441 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-a350d773-c30d-45fc-bf1c-a6bfa66af0a3-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-1564aae3-8916-4c02-b9b8-86ebcaa2e75e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-1564aae3-8916-4c02-b9b8-86ebcaa2e75e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" acquired by "delete_volume" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559e2df-446d-4fed-af9f-44c184d3ab64]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:37 devstack sudo[100812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:37 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:38 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 1.103s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:38 devstack sudo[100817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e
Sep 11 23:13:38 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (040f9bfe-a3fd-468b-8e78-667f2bfe000a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a7ff21-f3a6-496e-9622-3ad78a7889b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:39 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" returned: 0 in 0.783s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a7ff21-f3a6-496e-9622-3ad78a7889b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-268881914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75540a33-4547-4489-99ba-2039c0ffd7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141a971fc9b472a9d174c5eded70b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:39Z,use_quota=True,user_id='c1c3115f90444abe926bc92b3fcb2705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d10ba6a-3ec2-4689-9590-6e1c9d5622b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d10ba6a-3ec2-4689-9590-6e1c9d5622b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385dfaa3-a6a7-4359-b86c-67c352264941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385dfaa3-a6a7-4359-b86c-67c352264941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75540a33-4547-4489-99ba-2039c0ffd7b8', 'volume_name': 'volume-75540a33-4547-4489-99ba-2039c0ffd7b8', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eb55c6-4129-43fc-8344-82c5fdef77c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34eb55c6-4129-43fc-8344-82c5fdef77c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518ed09-52fb-45d3-9935-7d2167c81d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Volume 75540a33-4547-4489-99ba-2039c0ffd7b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75540a33-4547-4489-99ba-2039c0ffd7b8', 'volume_size': 1}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-1564aae3-8916-4c02-b9b8-86ebcaa2e75e" released by "delete_volume" :: held 2.166s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['b8e1f2aa-f2df-40f8-8e2a-b645829d81e5', '66ae644a-b58d-4736-a161-6cb2dd3733ec', '49363b04-26e6-4281-be65-3dddd5589802', '8489e67e-db34-440e-aa2f-24292b57bcd6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:40 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:40 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:40 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.927s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:40 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Deleted volume successfully.
Sep 11 23:13:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2a081d3d-5c28-4a51-8696-bfc9cb20bcc7 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-1564aae3-8916-4c02-b9b8-86ebcaa2e75e-delete_volume" released by "delete_volume" :: held 3.693s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:41 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7" returned: 0 in 4.918s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:13:41 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Converted 1024.00 MB image at 208.17 MB/s
Sep 11 23:13:41 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 is being set with open permissions: ugo+rw
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:41 devstack sudo[100824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7
Sep 11 23:13:41 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:41 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" released by "_copy_volume_from_snapshot" :: held 6.084s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=92,cinder:UPDATE=98,cinder:DELETE=8,cinder:INSERT=25 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3-728e850a-1ea2-40b0-b524-4aa5e64a21a7" released by "_create_volume_from_snapshot" :: held 6.178s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.196s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.945s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-268881914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75540a33-4547-4489-99ba-2039c0ffd7b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141a971fc9b472a9d174c5eded70b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:39Z,use_quota=True,user_id='c1c3115f90444abe926bc92b3fcb2705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Creating volume 75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:41 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:41 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 1073741824
Sep 11 23:13:41 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130d2125-773f-4be4-8592-0c5d267633ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7', 'volume_size': 1, 'snapshot_id': '87e9de2b-83fe-4472-b493-fd10222d17e3'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2456ad73-a067-4356-a838-52029f8cf3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Volume volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 (728e850a-1ea2-40b0-b524-4aa5e64a21a7): created successfully
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2456ad73-a067-4356-a838-52029f8cf3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Flow 'volume_create_manager' (19496d80-b3ab-428a-af87-706b39351856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-094459f7-d7ed-4c13-ad9f-5955f0e4754e tempest-VolumeDependencyTests-401730106 None] Created volume successfully.
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (272a19f0-9b45-497e-88fd-54206379f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9079f7f4-2749-4866-a3d4-bc7e11219c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9079f7f4-2749-4866-a3d4-bc7e11219c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-552986268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b0b96b-220a-4ca6-96e6-d44d556ad699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:42Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef5c9bc-2820-4db8-9447-a078693571bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef5c9bc-2820-4db8-9447-a078693571bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc7430-365c-4276-873c-767635c7920e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fc7430-365c-4276-873c-767635c7920e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8b0b96b-220a-4ca6-96e6-d44d556ad699', 'volume_name': 'volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9476b2-0115-4b05-8f03-a7ece3c49dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9476b2-0115-4b05-8f03-a7ece3c49dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f327871-f353-408f-9bc7-555f81c150b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Volume e8b0b96b-220a-4ca6-96e6-d44d556ad699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699', 'volume_size': 1}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-87e9de2b-83fe-4472-b493-fd10222d17e3-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-87e9de2b-83fe-4472-b493-fd10222d17e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Deleting offline snapshot 87e9de2b-83fe-4472-b493-fd10222d17e3 of volume d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] snapshot_file for this snap is: volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7739f1-ea32-4a99-af64-23564549d75c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:42 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 1073741824" returned: 0 in 0.530s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:42 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:42 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:42 devstack sudo[100836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:42 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:42 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.280s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-552986268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8b0b96b-220a-4ca6-96e6-d44d556ad699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:42Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Creating volume e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:42 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:42 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0edec8f-6494-4c52-a2a7-68ff54740333(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:42 devstack sudo[100843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 1073741824
Sep 11 23:13:42 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a518ed09-52fb-45d3-9935-7d2167c81d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75540a33-4547-4489-99ba-2039c0ffd7b8', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45a4948-843f-4433-8d6b-f70f83c92769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d6452-549c-43c5-820a-9b6e9b2b1c84]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:42 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Volume volume-75540a33-4547-4489-99ba-2039c0ffd7b8 (75540a33-4547-4489-99ba-2039c0ffd7b8): created successfully
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45a4948-843f-4433-8d6b-f70f83c92769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (040f9bfe-a3fd-468b-8e78-667f2bfe000a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4bbaf817-e3db-4318-909d-3c9ea6fe731b tempest-VolumesDeleteCascade-1316850358 None] Created volume successfully.
Sep 11 23:13:42 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:42 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:42 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 1073741824" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:42 devstack sudo[100853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:13:42 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:43 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.589s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:43 devstack sudo[100856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:43 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:43 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.244s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f327871-f353-408f-9bc7-555f81c150b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd83362d-dd2d-4c40-8048-e76594b5218b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Volume volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 (e8b0b96b-220a-4ca6-96e6-d44d556ad699): created successfully
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd83362d-dd2d-4c40-8048-e76594b5218b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (272a19f0-9b45-497e-88fd-54206379f06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c789bffc-5c58-4d37-9735-54473abc97cf tempest-VolumesSnapshotTestJSON-1232924101 None] Created volume successfully.
Sep 11 23:13:43 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.370s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:43 devstack sudo[100862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3
Sep 11 23:13:43 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Creating offline snapshot 1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 of volume 75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0e1d75-da61-472b-a639-4b76e380f075]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:43 devstack sudo[100866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:43 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:43 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333.87e9de2b-83fe-4472-b493-fd10222d17e3" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-87e9de2b-83fe-4472-b493-fd10222d17e3" released by "_delete_snapshot" :: held 1.758s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" released by "delete_snapshot" :: held 1.785s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Created reservations ['30f64af2-6c29-444d-812c-4b72e2c2ad16', '118ce16d-19ac-442b-86f1-631ee69411b4', '71f50ff6-cb53-47b5-a7ca-7bc00397a754', '8019b26f-68bc-4707-a527-6ae3951bf49e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Delete snapshot completed successfully.
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7eafd00e-4138-4a1b-a610-1d190e7361b8 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-87e9de2b-83fe-4472-b493-fd10222d17e3-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:43 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.457s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:43 devstack sudo[100874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 1G
Sep 11 23:13:43 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-d0edec8f-6494-4c52-a2a7-68ff54740333-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "cinder-d0edec8f-6494-4c52-a2a7-68ff54740333-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88a96b-d9fc-4cff-ac55-a423fb8b2b89]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:44 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 1G" returned: 0 in 0.529s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:44 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:44 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:44 devstack sudo[100882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:44 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a24f400a-dd38-4004-a28f-ab24365e2d02 req-5c998326-0f11-4521-9065-8844249f201a tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:44 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:44 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 is being set with open permissions: ugo+rw
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:44 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:44 devstack sudo[100901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:44 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:44 devstack sudo[100902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333
Sep 11 23:13:44 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d0edec8f-6494-4c52-a2a7-68ff54740333" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-d0edec8f-6494-4c52-a2a7-68ff54740333" released by "delete_volume" :: held 0.722s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:45 devstack sudo[100907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info
Sep 11 23:13:45 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Created reservations ['07a32afe-a8f1-457c-91a0-0dc3aeaa01e4', '035d68fa-5b85-4b8c-81e0-e7e0e86ea4fa', '4dd1420e-6001-4d6a-8686-e52722a5b647', '4d3ef80e-1e88-4c8c-a7cc-982ab117bce7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:45 devstack sudo[100909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:45 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info is being set with open permissions: ugo+rw
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:45 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info
Sep 11 23:13:45 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-728e850a-1ea2-40b0-b524-4aa5e64a21a7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.261s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Deleted volume successfully.
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-728e850a-1ea2-40b0-b524-4aa5e64a21a7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-89f4b801-df9a-4744-ba4f-560cb4c9c63c tempest-VolumeDependencyTests-401730106 None] Lock "cinder-d0edec8f-6494-4c52-a2a7-68ff54740333-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2794510-88fd-475f-9a9d-2d9b8b2fe723]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:45 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.info" returned: 0 in 0.322s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.774s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Creating offline snapshot 17ba5cc7-a418-4a97-aec6-f4d38d3184ea of volume e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:45 devstack sudo[100916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7
Sep 11 23:13:45 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2f7aae16-d486-40f0-b4b7-9aa9361d3877 tempest-VolumesDeleteCascade-1316850358 None] Create snapshot completed successfully
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2726f66d-90e0-4052-b7f1-0ab551bf3385]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:45 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:13:45 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:45 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7
Sep 11 23:13:46 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:46 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.362s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea 1G
Sep 11 23:13:46 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-728e850a-1ea2-40b0-b524-4aa5e64a21a7" returned: 0 in 0.244s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-quobyte-728e850a-1ea2-40b0-b524-4aa5e64a21a7" released by "delete_volume" :: held 0.666s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Created reservations ['36381e39-c9d0-47db-b309-2b820d739fac', '3b8219b5-6762-470e-8e6b-3c1c83bdaa6a', 'baca2b12-d460-4e0d-bd7a-2d7f6432bad2', '8fd2d7dc-0891-432e-b270-fca8f6ff3f3a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:46 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:46 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea 1G" returned: 0 in 0.413s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:13:46 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:46 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Deleted volume successfully.
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-58e846cb-980a-45dc-8a1c-571774d21ae7 tempest-VolumeDependencyTests-401730106 None] Lock "cinder-728e850a-1ea2-40b0-b524-4aa5e64a21a7-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:46 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.308s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:46 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea is being set with open permissions: ugo+rw
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:46 devstack sudo[100947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:13:46 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:47 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:47 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info
Sep 11 23:13:47 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:47 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:47 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info is being set with open permissions: ugo+rw
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:47 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info
Sep 11 23:13:47 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:47 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.info" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a24f400a-dd38-4004-a28f-ab24365e2d02 req-5c998326-0f11-4521-9065-8844249f201a tempest-TestStampPattern-1099253805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-a24f400a-dd38-4004-a28f-ab24365e2d02 req-5c998326-0f11-4521-9065-8844249f201a tempest-TestStampPattern-1099253805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.796s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f3b49431-3791-4dad-a9c0-d599f0a4ecaa tempest-VolumesSnapshotTestJSON-1232924101 None] Create snapshot completed successfully
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Creating offline snapshot 93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 of volume 75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0afa9a-2ded-4bde-8315-c7d98ae9f849]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-a24f400a-dd38-4004-a28f-ab24365e2d02 req-5c998326-0f11-4521-9065-8844249f201a tempest-TestStampPattern-1099253805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-1025b5a1-c6a8-4033-a975-6924524940df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7378de05-32ad-4156-8dd5-e89af0a78a01', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:13:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-a24f400a-dd38-4004-a28f-ab24365e2d02 req-5c998326-0f11-4521-9065-8844249f201a tempest-TestStampPattern-1099253805 None] attachment_update completed successfully.
Sep 11 23:13:47 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:47 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:48 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.499s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75540a33-4547-4489-99ba-2039c0ffd7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:48 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 1G
Sep 11 23:13:48 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:13:49 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 1G" returned: 0 in 0.785s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:49 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:49 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (b5124dd1-69eb-49a5-a58e-18b728604a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31af13ff-00bf-4ee3-b49d-0b498fea0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31af13ff-00bf-4ee3-b49d-0b498fea0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-573164363',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63353243-9750-49a3-85d5-7505bc3a9a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b59aa0605c4c454aab0aa2923c1f73b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17ba5cc7-a418-4a97-aec6-f4d38d3184ea,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:13:49Z,use_quota=True,user_id='d9aa04ac311644b59733c8ef94be7ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ed9f82-b002-43e6-92e3-9bb5e698a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ed9f82-b002-43e6-92e3-9bb5e698a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de2b01-9d52-45ed-94f1-71f0fe7e258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8de2b01-9d52-45ed-94f1-71f0fe7e258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63353243-9750-49a3-85d5-7505bc3a9a80', 'volume_name': 'volume-63353243-9750-49a3-85d5-7505bc3a9a80', 'volume_size': 1, 'snapshot_id': '17ba5cc7-a418-4a97-aec6-f4d38d3184ea'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c47e292-4eda-4419-b719-114b463a29b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c47e292-4eda-4419-b719-114b463a29b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9ea101-e922-4a43-a021-25fb722a0ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:49 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume 63353243-9750-49a3-85d5-7505bc3a9a80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63353243-9750-49a3-85d5-7505bc3a9a80', 'volume_size': 1, 'snapshot_id': '17ba5cc7-a418-4a97-aec6-f4d38d3184ea'}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:49 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:49 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 is being set with open permissions: ugo+rw
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:49 devstack sudo[101355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:49 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:49 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.459s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-63353243-9750-49a3-85d5-7505bc3a9a80" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-63353243-9750-49a3-85d5-7505bc3a9a80" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating volume 63353243-9750-49a3-85d5-7505bc3a9a80 from snapshot 17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-985b1853-3037-4a1e-beea-b5680afae1d9 tempest-VolumesDeleteCascade-1316850358 None] Create snapshot completed successfully
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] snapshot: 17ba5cc7-a418-4a97-aec6-f4d38d3184ea, volume: 63353243-9750-49a3-85d5-7505bc3a9a80,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce0592-4a6f-4bad-a718-1113bc9f01c4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:49 devstack sudo[101358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:13:49 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:50 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[919de396-e198-40e4-bd44-2f99dc1b6e6d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-75540a33-4547-4489-99ba-2039c0ffd7b8-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-75540a33-4547-4489-99ba-2039c0ffd7b8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Performing cascade delete. {{(pid=88022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 11 23:13:50 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:13:50 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Deleting offline snapshot 1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 of volume 75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] snapshot_file for this snap is: volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61481fe-dad2-4851-b163-88eb14be5adb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:50 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:50 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:50 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:50 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80
Sep 11 23:13:50 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:50 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.388s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75540a33-4547-4489-99ba-2039c0ffd7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacb3c30-fb14-42c3-8cdf-f64da98f3cdd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:50 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:50 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:51 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.589s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[678f1748-43a7-4761-9849-a636a54888c7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:51 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:51 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-f18360e8-c984-4696-8699-3e7345a586e6 req-0a56fb62-e007-408f-ac97-664739badd08 tempest-TestStampPattern-1099253805 None] Terminate volume connection completed successfully.
Sep 11 23:13:52 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-f18360e8-c984-4696-8699-3e7345a586e6 req-0a56fb62-e007-408f-ac97-664739badd08 tempest-TestStampPattern-1099253805 None] Deleting attachment 7378de05-32ad-4156-8dd5-e89af0a78a01. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:13:52 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 1.203s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75540a33-4547-4489-99ba-2039c0ffd7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e3f1bb-7204-4520-b6bf-7ffc982152cc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:53 devstack sudo[101440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:53 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:53 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 1.077s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75540a33-4547-4489-99ba-2039c0ffd7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0e0b0-e9f4-4772-b938-4ab1a95756c2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:54 devstack sudo[101448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:54 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:55 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 1.461s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:55 devstack sudo[101475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:55 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:56 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.835s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:56 devstack sudo[101482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257
Sep 11 23:13:56 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:56 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80" returned: 0 in 5.966s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:13:56 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Converted 1024.00 MB image at 171.54 MB/s
Sep 11 23:13:56 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 is being set with open permissions: ugo+rw
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:56 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80
Sep 11 23:13:56 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:56 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" returned: 0 in 0.499s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 -F qcow2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:56 devstack sudo[101487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 -F qcow2
Sep 11 23:13:56 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:56 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" released by "_copy_volume_from_snapshot" :: held 7.210s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-63353243-9750-49a3-85d5-7505bc3a9a80" released by "_create_volume_from_snapshot" :: held 7.292s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.313s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9ea101-e922-4a43-a021-25fb722a0ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63353243-9750-49a3-85d5-7505bc3a9a80', 'volume_size': 1, 'snapshot_id': '17ba5cc7-a418-4a97-aec6-f4d38d3184ea'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ed5223-be86-4841-88d4-566e6064f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:13:57 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Volume volume-63353243-9750-49a3-85d5-7505bc3a9a80 (63353243-9750-49a3-85d5-7505bc3a9a80): created successfully
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ed5223-be86-4841-88d4-566e6064f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Flow 'volume_create_manager' (b5124dd1-69eb-49a5-a58e-18b728604a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:13:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7ae4d2c2-b58c-4030-9f28-a5a220d8f498 tempest-VolumesSnapshotTestJSON-1232924101 None] Created volume successfully.
Sep 11 23:13:57 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75540a33-4547-4489-99ba-2039c0ffd7b8 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 -F qcow2" returned: 0 in 0.442s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257" released by "_delete_snapshot" :: held 6.840s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" released by "delete_snapshot" :: held 6.868s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['827dafdc-0361-453a-a103-a72cfb6dee67', '1e09b103-0b58-44ca-99bf-8b2c74ef3c3a', '8b6809f7-d6d8-48db-a0c6-c6e90421cf5d', 'f63b6f1b-01ab-430d-b300-e417945ae57b'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Delete snapshot completed successfully.
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-1bb0ca15-34cb-4a10-bdb9-51ecbfb3e257-delete_snapshot" released by "delete_snapshot" :: held 7.065s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Deleting offline snapshot 93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 of volume 75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] snapshot_file for this snap is: volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e38721-6415-4861-9181-abe9a0af415b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:57 devstack sudo[101507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:57 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-63353243-9750-49a3-85d5-7505bc3a9a80-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:57 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 0.408s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75540a33-4547-4489-99ba-2039c0ffd7b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-63353243-9750-49a3-85d5-7505bc3a9a80-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b6c3d9-a0f9-4047-8d91-683696d0952e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" acquired by "delete_volume" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6050b-bc95-497d-a2bb-161fff5a3899]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack sudo[101512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:58 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80
Sep 11 23:13:58 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:58 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80" returned: 0 in 0.398s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80
Sep 11 23:13:58 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 0.340s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack sudo[101530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57
Sep 11 23:13:58 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63353243-9750-49a3-85d5-7505bc3a9a80" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-63353243-9750-49a3-85d5-7505bc3a9a80" released by "delete_volume" :: held 0.705s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['ccc2c661-85c6-4d56-86b0-3e1486bbf7c0', '82460a98-dbbe-4e7d-b278-0a329fc445e2', '6b016e7d-2ce2-4c1d-8a6a-b9d0b7ff7f57', '55268800-a971-477f-a426-1cc3c45ae013'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:58 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:13:58 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:58 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8.93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57" released by "_delete_snapshot" :: held 1.591s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" released by "delete_snapshot" :: held 1.614s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['8ff53295-535e-467d-971b-248c6a786478', 'ff2e4bcf-7ef2-4c94-8bc7-9bc85fcc1123', '9a3c9a99-874a-4811-9de5-8bd7dab57b88', '0e5a872d-889f-4d01-8ba7-544dcb67249d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:13:59 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:13:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Deleted volume successfully.
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cf356c4-0987-4661-b6a4-80ea5957744a tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-63353243-9750-49a3-85d5-7505bc3a9a80-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Delete snapshot completed successfully.
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-93f53d12-6bf3-4b0b-8460-2a57d8fa7d57-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Snapshots deleted, issuing volume delete {{(pid=88022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Deleting offline snapshot 17ba5cc7-a418-4a97-aec6-f4d38d3184ea of volume e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] snapshot_file for this snap is: volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-1025b5a1-c6a8-4033-a975-6924524940df-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" acquired by "delete_volume" :: waited 0.059s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "cinder-1025b5a1-c6a8-4033-a975-6924524940df-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aa7e98-963c-4d2a-8224-ac173a973234]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835fe2e-f48b-449a-9cfc-757c6e92e911]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12b3b3-9f9d-4295-b02d-59520d525682]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack sudo[101536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:13:59 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:59 devstack sudo[101537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:59 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:59 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df
Sep 11 23:13:59 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:59 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.371s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:13:59 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.375s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2009353a-a3c5-448f-b92f-e9dbc4a5ce35]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack sudo[101548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8
Sep 11 23:13:59 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:59 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:13:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:13:59 devstack sudo[101549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:13:59 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:13:59 devstack sudo[101554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df
Sep 11 23:13:59 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:00 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-75540a33-4547-4489-99ba-2039c0ffd7b8" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-75540a33-4547-4489-99ba-2039c0ffd7b8" released by "delete_volume" :: held 0.713s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['d1d30039-4ad6-47b3-8f5a-fcb54c290d9a', '54633bb6-2b88-499d-a94e-ffda64b71730', '733cc143-789a-463f-a356-9e34c017a778', '0fd35b88-90a0-421a-8575-cc71e02374b9'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:00 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1025b5a1-c6a8-4033-a975-6924524940df" returned: 0 in 0.289s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-1025b5a1-c6a8-4033-a975-6924524940df" released by "delete_volume" :: held 0.738s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:00 devstack sudo[101561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:00 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Created reservations ['190bff6b-6e51-4535-83af-b2124a89d42a', '23b73b3b-10c8-4c2a-9b9c-c07933bb7cc2', 'b34998f1-1cdc-408a-8b71-43d5a627ef07', '085164e0-7a8a-449a-ae0a-f44a4a7b7406'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:00 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.590s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:00 devstack sudo[101564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:00 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:00 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:14:00 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:00 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Deleted volume successfully.
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4625aef1-15ad-4579-973b-eadc10669b1f tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-75540a33-4547-4489-99ba-2039c0ffd7b8-delete_volume" released by "delete_volume" :: held 10.361s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:00 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Deleted volume successfully.
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9462423-30b3-42fc-acae-7a1286509e4b tempest-TestStampPattern-1099253805 None] Lock "cinder-1025b5a1-c6a8-4033-a975-6924524940df-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:00 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.505s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-af909496-0dc2-4868-a985-9d075bc59116-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:00 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea
Sep 11 23:14:00 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-af909496-0dc2-4868-a985-9d075bc59116-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Deleting offline snapshot af909496-0dc2-4868-a985-9d075bc59116 of volume e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] snapshot_file for this snap is: volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[286157f8-d02b-4fb0-a7cc-52508c0e893a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:01 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:14:01 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:01 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699.17ba5cc7-a418-4a97-aec6-f4d38d3184ea" returned: 0 in 0.297s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-17ba5cc7-a418-4a97-aec6-f4d38d3184ea" released by "_delete_snapshot" :: held 1.945s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" released by "delete_snapshot" :: held 1.984s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['2b7ac0a6-a9b2-4ef1-be03-d27a306f1a0c', '02b4ee0d-1f34-4639-9bf8-1cae6b6c2401', '3844675e-1761-4405-972b-ace97405ab5e', '591eb683-98e8-4575-a20f-8855b56bb167'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Delete snapshot completed successfully.
Sep 11 23:14:01 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c120ca3a-d9ed-4f5f-b6b3-3a801b699e7c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-17ba5cc7-a418-4a97-aec6-f4d38d3184ea-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e91ecb4b-f268-4854-8308-db61b021a55c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d41da2-7e29-42e7-9ec1-39d64fb42c0d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:01 devstack sudo[101582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:14:01 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (09e84c0f-f069-463e-8aff-b9a639c3c4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74213edc-7d62-41bc-8190-9a276a0d22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74213edc-7d62-41bc-8190-9a276a0d22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-733877803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d565de-a44c-43e4-9749-a27b84700252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141a971fc9b472a9d174c5eded70b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:02Z,use_quota=True,user_id='c1c3115f90444abe926bc92b3fcb2705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd619465-d524-44d6-8032-1bbb172b6fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd619465-d524-44d6-8032-1bbb172b6fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0537fd-c6b9-4de6-a61b-8c4eeb2f0ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0537fd-c6b9-4de6-a61b-8c4eeb2f0ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d565de-a44c-43e4-9749-a27b84700252', 'volume_name': 'volume-c3d565de-a44c-43e4-9749-a27b84700252', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd58e34-7d9d-42b5-940b-bab43aa84ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dd58e34-7d9d-42b5-940b-bab43aa84ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b9565b-ac84-47f3-97a2-5d652adfc1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Volume c3d565de-a44c-43e4-9749-a27b84700252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d565de-a44c-43e4-9749-a27b84700252', 'volume_size': 1}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-733877803',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d565de-a44c-43e4-9749-a27b84700252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141a971fc9b472a9d174c5eded70b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:02Z,use_quota=True,user_id='c1c3115f90444abe926bc92b3fcb2705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Creating volume c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:01 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:01 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 1073741824
Sep 11 23:14:01 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:02 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.557s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:02 devstack sudo[101594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:14:02 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:02 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 1073741824" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:02 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:02 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:02 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.343s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:02 devstack sudo[101601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116
Sep 11 23:14:02 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:02 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b9565b-ac84-47f3-97a2-5d652adfc1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d565de-a44c-43e4-9749-a27b84700252', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74141175-96f8-4576-903c-e5a5387e33f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-e8b0b96b-220a-4ca6-96e6-d44d556ad699-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:02 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Volume volume-c3d565de-a44c-43e4-9749-a27b84700252 (c3d565de-a44c-43e4-9749-a27b84700252): created successfully
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74141175-96f8-4576-903c-e5a5387e33f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (09e84c0f-f069-463e-8aff-b9a639c3c4b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-e8b0b96b-220a-4ca6-96e6-d44d556ad699-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f26d77e3-ae4f-4245-9098-ac3777f2a11a tempest-VolumesDeleteCascade-1316850358 None] Created volume successfully.
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3cd2be-9257-4bf2-b38a-37d6ac7282bf]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:02 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c.af909496-0dc2-4868-a985-9d075bc59116" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-af909496-0dc2-4868-a985-9d075bc59116" released by "_delete_snapshot" :: held 1.756s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" released by "delete_snapshot" :: held 1.783s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:02 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:14:02 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Created reservations ['d75bafa6-b56a-40e4-9513-a70421e90f82', 'bf907d55-9bc0-47c4-8576-ea30eb678b09', 'f604f481-0bfb-4251-98d3-df02c4e45fb4', 'b6af426e-6509-461c-9ecf-aa7ad3c3e720'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Creating offline snapshot f1a56a1c-13a3-4a86-abb7-799077c777cd of volume c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:14:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Delete snapshot completed successfully.
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0da188-7a93-4205-ae0d-7418f437f496]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1e6c214a-7015-4cbe-8d24-eaf935043dd2 tempest-TestStampPattern-1099253805 None] Lock "cinder-af909496-0dc2-4868-a985-9d075bc59116-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:03 devstack sudo[101607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:03 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:03 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.445s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:03 devstack sudo[101613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699
Sep 11 23:14:03 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:03 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:03 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8b0b96b-220a-4ca6-96e6-d44d556ad699" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:03 devstack sudo[101619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd 1G
Sep 11 23:14:03 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-e8b0b96b-220a-4ca6-96e6-d44d556ad699" released by "delete_volume" :: held 0.781s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['9bfb716b-2d9f-4ab6-819c-9837c4a66485', '2ae29f21-c8bd-4647-8dbe-1290e75c2e72', '03dc874f-cb94-464e-8bc0-7747617e62cb', '7085c078-2e7e-46c7-9133-4232728c3855'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:03 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:03 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-0ade5613-7796-4ba5-a3a8-73f04ce5e272-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-0ade5613-7796-4ba5-a3a8-73f04ce5e272-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:03 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.392s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Deleted volume successfully.
Sep 11 23:14:03 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd 1G" returned: 0 in 0.617s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d565de-a44c-43e4-9749-a27b84700252 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-de271439-4acc-47b6-ba4a-d828c40f0baa tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-e8b0b96b-220a-4ca6-96e6-d44d556ad699-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:03 devstack sudo[101629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d565de-a44c-43e4-9749-a27b84700252 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:03 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" acquired by "delete_volume" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fc455-f712-4831-bd3c-60b42ddd96bd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:04 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272
Sep 11 23:14:04 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:04 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3d565de-a44c-43e4-9749-a27b84700252 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.456s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:04 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd is being set with open permissions: ugo+rw
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:04 devstack sudo[101638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:04 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:04 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272" returned: 0 in 0.601s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:04 devstack sudo[101657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272
Sep 11 23:14:04 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:04 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.458s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:04 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info
Sep 11 23:14:04 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:05 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0ade5613-7796-4ba5-a3a8-73f04ce5e272" returned: 0 in 0.420s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-quobyte-0ade5613-7796-4ba5-a3a8-73f04ce5e272" released by "delete_volume" :: held 1.105s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Created reservations ['0494575e-5f4c-4656-a114-419769484e5c', 'a603a16c-963c-4e19-b599-4fb3d96877b5', '589a208d-5f82-4161-a3ad-b53cdad138c9', '7ee789c7-a028-4e78-af46-0c24d682c6ed'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:05 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:05 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info is being set with open permissions: ugo+rw
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:05 devstack sudo[101669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info
Sep 11 23:14:05 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:05 devstack sudo[101671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:05 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:05 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:05 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Deleted volume successfully.
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ee386625-c1e8-40c2-bbaf-daded1c22b1c tempest-VolumesSnapshotTestJSON-1232924101 None] Lock "cinder-0ade5613-7796-4ba5-a3a8-73f04ce5e272-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:05 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.info" returned: 0 in 0.443s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:05 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c4d73bb7-7e85-445d-a0f1-18d07de5d4bb tempest-VolumesDeleteCascade-1316850358 None] Create snapshot completed successfully
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (235845a2-1731-4d9f-be2e-00a390648c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca7f01-5bc9-4070-a4b3-b2acd418f35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ca7f01-5bc9-4070-a4b3-b2acd418f35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1700245426',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ce9817-0483-44f0-b511-f3fbb6c9fa78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8141a971fc9b472a9d174c5eded70b92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f1a56a1c-13a3-4a86-abb7-799077c777cd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:07Z,use_quota=True,user_id='c1c3115f90444abe926bc92b3fcb2705',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fc136e-1a17-4870-b4af-3ca6e8afe02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fc136e-1a17-4870-b4af-3ca6e8afe02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be8cc50-6ac4-43df-b219-8478f3af5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be8cc50-6ac4-43df-b219-8478f3af5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8ce9817-0483-44f0-b511-f3fbb6c9fa78', 'volume_name': 'volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78', 'volume_size': 1, 'snapshot_id': 'f1a56a1c-13a3-4a86-abb7-799077c777cd'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ac6e45-5293-48b6-b0ec-74d5bb0d497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ac6e45-5293-48b6-b0ec-74d5bb0d497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d09ccb2-d4b8-474a-b3f3-b8738ba94674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Volume b8ce9817-0483-44f0-b511-f3fbb6c9fa78: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78', 'volume_size': 1, 'snapshot_id': 'f1a56a1c-13a3-4a86-abb7-799077c777cd'}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Creating volume b8ce9817-0483-44f0-b511-f3fbb6c9fa78 from snapshot f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] snapshot: f1a56a1c-13a3-4a86-abb7-799077c777cd, volume: b8ce9817-0483-44f0-b511-f3fbb6c9fa78,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8314519-5a01-46c4-9a24-d5f68382d009]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-e91ecb4b-f268-4854-8308-db61b021a55c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "cinder-e91ecb4b-f268-4854-8308-db61b021a55c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Acquiring lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:07 devstack sudo[101678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:07 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce6af00-8453-4b77-b2ed-0f978c630f1e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:07 devstack sudo[101680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:14:07 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:07 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3d565de-a44c-43e4-9749-a27b84700252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4dcb31-b402-489f-aa66-f065ee46c632]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:07 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:07 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:07 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.434s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:07 devstack sudo[101690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c
Sep 11 23:14:07 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:07 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.425s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:07 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78
Sep 11 23:14:07 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:07 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e91ecb4b-f268-4854-8308-db61b021a55c" returned: 0 in 0.300s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "cinder-quobyte-e91ecb4b-f268-4854-8308-db61b021a55c" released by "delete_volume" :: held 0.805s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Created reservations ['8eb2bca3-83bf-45ab-8eea-8f38a3cd0fde', 'fef1df5e-af1c-4de7-bac1-c0b0fff9972e', '504a08df-bc8c-4f7a-b404-e51f65f688b6', '74f1077e-39f9-4ae8-9068-12db97e318d7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:08 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:08 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:08 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.295s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:08 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Deleted volume successfully.
Sep 11 23:14:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c75bbe1e-5c4e-4000-b2ac-e0a4b672d7b6 tempest-TestStampPattern-1099253805 None] Lock "cinder-e91ecb4b-f268-4854-8308-db61b021a55c-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:13 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" returned: 0 in 5.409s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:14:13 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Converted 1024.00 MB image at 189.28 MB/s
Sep 11 23:14:13 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 is being set with open permissions: ugo+rw
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:13 devstack sudo[101751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78
Sep 11 23:14:13 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:13 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" returned: 0 in 0.308s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" released by "_copy_volume_from_snapshot" :: held 6.675s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" released by "_create_volume_from_snapshot" :: held 6.757s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.774s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d09ccb2-d4b8-474a-b3f3-b8738ba94674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78', 'volume_size': 1, 'snapshot_id': 'f1a56a1c-13a3-4a86-abb7-799077c777cd'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e3d244-29c5-4b92-963e-4ba46ed1a0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Volume volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 (b8ce9817-0483-44f0-b511-f3fbb6c9fa78): created successfully
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e3d244-29c5-4b92-963e-4ba46ed1a0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Flow 'volume_create_manager' (235845a2-1731-4d9f-be2e-00a390648c35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3399328e-cc21-4adc-a1d0-87a3a291efa5 tempest-VolumesDeleteCascade-1316850358 None] Created volume successfully.
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-c3d565de-a44c-43e4-9749-a27b84700252-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-c3d565de-a44c-43e4-9749-a27b84700252-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Performing cascade delete. {{(pid=88022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-f1a56a1c-13a3-4a86-abb7-799077c777cd-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-f1a56a1c-13a3-4a86-abb7-799077c777cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Deleting offline snapshot f1a56a1c-13a3-4a86-abb7-799077c777cd of volume c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] snapshot_file for this snap is: volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72704f-e682-49e4-a2bc-cf32e67924b2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:14 devstack sudo[101755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:14 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:15 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3d565de-a44c-43e4-9749-a27b84700252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[52589b5f-ff4d-4140-b13b-282dc0c19403]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:15 devstack sudo[101760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:15 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:15 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.677s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:15 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:15 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:16 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:16 devstack sudo[101772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd
Sep 11 23:14:16 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:16 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252.f1a56a1c-13a3-4a86-abb7-799077c777cd" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-f1a56a1c-13a3-4a86-abb7-799077c777cd" released by "_delete_snapshot" :: held 1.902s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" released by "delete_snapshot" :: held 1.930s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['c24088ca-d5d2-42c1-9288-8cd9956e8f02', 'fd530de5-2a93-4eee-a17a-2cf212672f7f', 'da74589e-0b97-4100-8861-1f71345f17d0', '0a9477be-8020-4b4e-bd5d-0f53a3188c8c'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Delete snapshot completed successfully.
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-f1a56a1c-13a3-4a86-abb7-799077c777cd-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Snapshots deleted, issuing volume delete {{(pid=88022) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e499e349-fd84-4971-b9b6-f63ebf3452db]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:17 devstack sudo[101776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:17 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:17 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:17 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252
Sep 11 23:14:17 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Flow 'volume_create_manager' (896cbaba-b40e-4fce-9e80-7951528b059a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56889144-5194-4a32-bfa6-2e848d2e3043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:17 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56889144-5194-4a32-bfa6-2e848d2e3043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-381743658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e34b20-7057-4edd-a943-f4fb1aae0d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbbf8e03054e96b2dc30a0e8336f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:18Z,use_quota=True,user_id='ccc69b5de3654e0895265e7af98e32c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ac5e6-f53c-450e-82f2-409c2543b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520ac5e6-f53c-450e-82f2-409c2543b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d51398-387c-4461-b4ba-dc015e0762a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d51398-387c-4461-b4ba-dc015e0762a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e34b20-7057-4edd-a943-f4fb1aae0d0e', 'volume_name': 'volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d8ef7d-637a-435d-be06-2c844a588242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d8ef7d-637a-435d-be06-2c844a588242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cf9f9a-f9ab-43a7-8181-d849fa53e412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:17 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e', 'volume_size': 1}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-381743658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e34b20-7057-4edd-a943-f4fb1aae0d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fbbf8e03054e96b2dc30a0e8336f31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:18Z,use_quota=True,user_id='ccc69b5de3654e0895265e7af98e32c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Creating volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:17 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c3d565de-a44c-43e4-9749-a27b84700252" returned: 0 in 0.403s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:17 devstack sudo[101784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e 1073741824
Sep 11 23:14:17 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-c3d565de-a44c-43e4-9749-a27b84700252" released by "delete_volume" :: held 0.884s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['e5d74271-1840-414e-89ba-36bbb8b87f76', 'd18cba2a-121e-4237-b70d-ffb941b6b64c', 'ebbd2785-33ea-49d3-b0cc-b544ecb85183', '5ce1cd85-e3aa-466e-917f-746690a45266'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:17 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:17 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-b8ce9817-0483-44f0-b511-f3fbb6c9fa78-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-b8ce9817-0483-44f0-b511-f3fbb6c9fa78-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:18 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:18 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.354s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e 1073741824" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Deleted volume successfully.
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa73a9a-280f-4beb-b6ea-58a71117d311]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bdd34131-677f-49ba-a089-4cce69c1324d tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-c3d565de-a44c-43e4-9749-a27b84700252-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:18 devstack sudo[101794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e
Sep 11 23:14:18 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:18 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78
Sep 11 23:14:18 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:18 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cf9f9a-f9ab-43a7-8181-d849fa53e412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71ff170-6c7e-4159-a02b-bc5fb74fefca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Volume volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e (e8e34b20-7057-4edd-a943-f4fb1aae0d0e): created successfully
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71ff170-6c7e-4159-a02b-bc5fb74fefca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Flow 'volume_create_manager' (896cbaba-b40e-4fce-9e80-7951528b059a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:18 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-93e3f0cd-f59a-4273-ae7b-9fa32979c909 tempest-VolumesSnapshotListTestJSON-1969145869 None] Created volume successfully.
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" returned: 0 in 0.480s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:18 devstack sudo[101802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78
Sep 11 23:14:18 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:19 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-quobyte-b8ce9817-0483-44f0-b511-f3fbb6c9fa78" released by "delete_volume" :: held 0.817s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Created reservations ['49d707a7-2392-4893-bc32-29cb58182c6a', '35738663-a4e5-40ce-8823-4da798e4981d', '66f45bdc-c289-4093-a719-4aca419b67f7', '1b74eb4b-764f-4f6c-9726-d0d884421ffb'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:19 devstack sudo[101805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:19 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:19 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Deleted volume successfully.
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5fddf2c1-765c-4663-8d93-eb8d17f2f39b tempest-VolumesDeleteCascade-1316850358 None] Lock "cinder-b8ce9817-0483-44f0-b511-f3fbb6c9fa78-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Creating offline snapshot 5536725b-fc41-458a-99d9-df4f5d770a44 of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:14:19 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d48823-0fd6-4724-a115-8f8c945d671a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:20 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e
Sep 11 23:14:20 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:20 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:20 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 1G
Sep 11 23:14:20 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:20 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 1G" returned: 0 in 0.475s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:20 devstack sudo[101818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:20 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:21 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.375s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 is being set with open permissions: ugo+rw
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:21 devstack sudo[101824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:21 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:21 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:21 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info
Sep 11 23:14:21 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:21 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info is being set with open permissions: ugo+rw
Sep 11 23:14:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:21 devstack sudo[101831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info
Sep 11 23:14:21 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:22 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.info" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e616ab6d-e4ba-4b89-be60-71c699cccdcf tempest-VolumesSnapshotListTestJSON-1969145869 None] Create snapshot completed successfully
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Creating offline snapshot 5843e2b6-23dd-443f-937b-e18242eb7db6 of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c9339a-2b9a-4126-b65c-2cd7084b9723]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:23 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:23 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:23 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.458s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:23 devstack sudo[101839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 1G
Sep 11 23:14:23 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:23 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Flow 'volume_create_manager' (c93ee3ce-919a-493c-957f-eed4c5f8e45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1bcff0-33b1-48dd-8f59-569e06724fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d1bcff0-33b1-48dd-8f59-569e06724fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-682527651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9788a8-a417-4add-bc66-38f9979acf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388f8489b03b4c23a96a9d4983fc7c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:24Z,use_quota=True,user_id='76e0a55390344d2b93bc77b8fbc4eb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06596263-0ce6-4af5-b02b-72a7eaba15c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06596263-0ce6-4af5-b02b-72a7eaba15c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6fb38-cb8e-4706-97f1-94f4c24dd6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6fb38-cb8e-4706-97f1-94f4c24dd6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9788a8-a417-4add-bc66-38f9979acf69', 'volume_name': 'volume-aa9788a8-a417-4add-bc66-38f9979acf69', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fff9422-4e23-4635-9de2-ac2d0e3e1235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fff9422-4e23-4635-9de2-ac2d0e3e1235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ac779-586d-4ae5-b948-d312cb1e1049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:24 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Volume aa9788a8-a417-4add-bc66-38f9979acf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9788a8-a417-4add-bc66-38f9979acf69', 'volume_size': 1}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:24 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 1G" returned: 0 in 0.538s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:24 devstack sudo[101851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:24 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:24 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:24 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 is being set with open permissions: ugo+rw
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:24 devstack sudo[101856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:24 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:24 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.706s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-682527651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9788a8-a417-4add-bc66-38f9979acf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='388f8489b03b4c23a96a9d4983fc7c96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:24Z,use_quota=True,user_id='76e0a55390344d2b93bc77b8fbc4eb41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Creating volume aa9788a8-a417-4add-bc66-38f9979acf69 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:25 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:25 devstack sudo[101859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 1073741824
Sep 11 23:14:25 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c59c2530-24db-4854-9ac7-a59f08903de6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Create snapshot completed successfully
Sep 11 23:14:25 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 1073741824" returned: 0 in 0.511s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:25 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69
Sep 11 23:14:25 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (8d1de770-4138-4336-9055-9e160096802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0058f174-3d76-4d4e-9fe1-527365b41895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0058f174-3d76-4d4e-9fe1-527365b41895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528477328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0951c29-50f6-4de9-b3d6-40284d125607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01598171-edf0-45f7-b211-ad969594a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01598171-edf0-45f7-b211-ad969594a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0819d76-362f-4894-89d7-57d53395af17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0819d76-362f-4894-89d7-57d53395af17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0951c29-50f6-4de9-b3d6-40284d125607', 'volume_name': 'volume-f0951c29-50f6-4de9-b3d6-40284d125607', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d287bba5-5e69-462f-bd0f-61666ad9bd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d287bba5-5e69-462f-bd0f-61666ad9bd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dc4061-123c-4e1e-8021-4c11585c010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Volume f0951c29-50f6-4de9-b3d6-40284d125607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0951c29-50f6-4de9-b3d6-40284d125607', 'volume_size': 1}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:25 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.069s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528477328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0951c29-50f6-4de9-b3d6-40284d125607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Creating volume f0951c29-50f6-4de9-b3d6-40284d125607 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:25 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (829ac779-586d-4ae5-b948-d312cb1e1049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9788a8-a417-4add-bc66-38f9979acf69', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fceda114-63b8-4c0f-9c1c-6ba5e08fb873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:25 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 1073741824
Sep 11 23:14:25 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Volume volume-aa9788a8-a417-4add-bc66-38f9979acf69 (aa9788a8-a417-4add-bc66-38f9979acf69): created successfully
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fceda114-63b8-4c0f-9c1c-6ba5e08fb873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Flow 'volume_create_manager' (c93ee3ce-919a-493c-957f-eed4c5f8e45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8bd5b54c-3a3f-4adf-986e-d877efd8c0f0 tempest-VolumesMetadataTest-845333306 None] Created volume successfully.
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (01fe956f-c7d8-4377-b8ff-d3002e3a16a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f65eb-7751-411b-a25c-3955ad7de7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (980f65eb-7751-411b-a25c-3955ad7de7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882943502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9820409f-fd82-4cf6-bcc3-e2208a827996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf769f45-1522-41bc-8b06-85380c6ee5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf769f45-1522-41bc-8b06-85380c6ee5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a38bd3e-6337-437a-bec4-9b02dd74d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a38bd3e-6337-437a-bec4-9b02dd74d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9820409f-fd82-4cf6-bcc3-e2208a827996', 'volume_name': 'volume-9820409f-fd82-4cf6-bcc3-e2208a827996', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f191a78-dbd5-470f-85d1-5bd3750c4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f191a78-dbd5-470f-85d1-5bd3750c4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401e61b-5366-4d4f-bce5-4ea4ef5a2bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Volume 9820409f-fd82-4cf6-bcc3-e2208a827996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9820409f-fd82-4cf6-bcc3-e2208a827996', 'volume_size': 1}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (d7d75578-2122-470b-aac3-b26889383e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa47ec-e577-4de2-89d7-0b9ad2525642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 1073741824" returned: 0 in 0.559s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aa47ec-e577-4de2-89d7-0b9ad2525642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184180759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cdaf06-ceb9-46f1-861f-7c9bf18215ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf2445f-9d2d-406a-9139-eba60d8b5093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf2445f-9d2d-406a-9139-eba60d8b5093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b096eb6c-bbb3-40c7-9c1b-3719883d0d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b096eb6c-bbb3-40c7-9c1b-3719883d0d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91cdaf06-ceb9-46f1-861f-7c9bf18215ff', 'volume_name': 'volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9796a43-6e90-4009-8028-ef2460bafd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9796a43-6e90-4009-8028-ef2460bafd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64b0479-8c4d-410f-9ba1-4d53fe6ed8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Volume 91cdaf06-ceb9-46f1-861f-7c9bf18215ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff', 'volume_size': 1}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:26 devstack sudo[101874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607
Sep 11 23:14:26 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (d28b9b2f-6dd1-48f9-8088-1adf7c415f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9beb2533-9fc9-4307-b91c-3f114062dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9beb2533-9fc9-4307-b91c-3f114062dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950207106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf13834-c546-47f8-bb1d-62814bf3872c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:27Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75492b8-31a0-4385-bf3a-80655207d3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75492b8-31a0-4385-bf3a-80655207d3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d059f15-d848-453f-ab64-7b6a7e5eff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d059f15-d848-453f-ab64-7b6a7e5eff23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaf13834-c546-47f8-bb1d-62814bf3872c', 'volume_name': 'volume-aaf13834-c546-47f8-bb1d-62814bf3872c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00efc44d-e1ee-4149-976e-3453484d2e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00efc44d-e1ee-4149-976e-3453484d2e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd341eb-3925-4148-801a-3f12b56a96da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Volume aaf13834-c546-47f8-bb1d-62814bf3872c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaf13834-c546-47f8-bb1d-62814bf3872c', 'volume_size': 1}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.035s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dc4061-123c-4e1e-8021-4c11585c010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0951c29-50f6-4de9-b3d6-40284d125607', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f3bda3-18a2-4370-b1da-547bd7477293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Creating offline snapshot e5866059-5f78-489a-a057-4cdf16040c4e of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7c6c3b-1f39-4fe7-9ded-271c8f3742d4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Volume volume-f0951c29-50f6-4de9-b3d6-40284d125607 (f0951c29-50f6-4de9-b3d6-40284d125607): created successfully
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f3bda3-18a2-4370-b1da-547bd7477293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (8d1de770-4138-4336-9055-9e160096802a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-32162300-8284-4b3f-a74e-ad32dced8c17 tempest-CreateVolumesFromImageTest-1062843527 None] Created volume successfully.
Sep 11 23:14:27 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:27 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (c044cba5-5617-4086-8f3e-5f6a7e42283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75cb76e-9ee6-471f-bbe0-7e994a34559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75cb76e-9ee6-471f-bbe0-7e994a34559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615672336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf0455c-6594-4b95-a120-39386621b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:27Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85536522-4565-4a49-a0fa-a85c7a3755d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85536522-4565-4a49-a0fa-a85c7a3755d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3609d9b1-d109-4224-9b9f-aa9ef39fd63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3609d9b1-d109-4224-9b9f-aa9ef39fd63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf0455c-6594-4b95-a120-39386621b62b', 'volume_name': 'volume-0bf0455c-6594-4b95-a120-39386621b62b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1124f6b-b441-4065-8649-a6f24c4d4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1124f6b-b441-4065-8649-a6f24c4d4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c375a47-863a-4a34-8b59-bec668b7854e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Volume 0bf0455c-6594-4b95-a120-39386621b62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf0455c-6594-4b95-a120-39386621b62b', 'volume_size': 1}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:27 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:27 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e 1G
Sep 11 23:14:27 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:27 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e 1G" returned: 0 in 0.527s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:27 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e
Sep 11 23:14:27 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Acquiring lock "cinder-aa9788a8-a417-4add-bc66-38f9979acf69-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "cinder-aa9788a8-a417-4add-bc66-38f9979acf69-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Acquiring lock "cinder-quobyte-aa9788a8-a417-4add-bc66-38f9979acf69" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "cinder-quobyte-aa9788a8-a417-4add-bc66-38f9979acf69" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59a7540-d45a-44e6-8677-bedb191dd4a8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:28 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:28 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e is being set with open permissions: ugo+rw
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:28 devstack sudo[101895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e
Sep 11 23:14:28 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:28 devstack sudo[101894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69
Sep 11 23:14:28 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:28 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.593s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882943502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9820409f-fd82-4cf6-bcc3-e2208a827996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Creating volume 9820409f-fd82-4cf6-bcc3-e2208a827996 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:28 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:28 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 1073741824
Sep 11 23:14:28 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-20037549-d6e0-4f79-aec3-375a64028e8e tempest-VolumesSnapshotListTestJSON-1969145869 None] Create snapshot completed successfully
Sep 11 23:14:28 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69" returned: 0 in 0.418s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:28 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69
Sep 11 23:14:28 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:28 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aa9788a8-a417-4add-bc66-38f9979acf69" returned: 0 in 0.276s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "cinder-quobyte-aa9788a8-a417-4add-bc66-38f9979acf69" released by "delete_volume" :: held 0.742s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:28 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Created reservations ['69c04bf5-91a5-4558-9e23-b4e3f33e9a45', 'bb39eea1-efad-4f8a-bc54-762098003ce7', '53cdca18-acd8-49e1-bebc-35b85fd30507', '65092193-0bb2-4a68-8cfa-006a0fb9ad10'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:29 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 1073741824" returned: 0 in 0.493s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:29 devstack sudo[101912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:29 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:29 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996
Sep 11 23:14:29 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:29 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.322s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Deleted volume successfully.
Sep 11 23:14:29 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996" returned: 0 in 0.340s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-feea9481-36f4-46fb-bca0-ae9101ac0593 tempest-VolumesMetadataTest-845333306 None] Lock "cinder-aa9788a8-a417-4add-bc66-38f9979acf69-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.867s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184180759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cdaf06-ceb9-46f1-861f-7c9bf18215ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:26Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Creating volume 91cdaf06-ceb9-46f1-861f-7c9bf18215ff {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:29 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3401e61b-5366-4d4f-bce5-4ea4ef5a2bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9820409f-fd82-4cf6-bcc3-e2208a827996', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc41893-79a2-4245-8306-01c98a93c524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:29 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff 1073741824
Sep 11 23:14:29 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Volume volume-9820409f-fd82-4cf6-bcc3-e2208a827996 (9820409f-fd82-4cf6-bcc3-e2208a827996): created successfully
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc41893-79a2-4245-8306-01c98a93c524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (01fe956f-c7d8-4377-b8ff-d3002e3a16a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e67a6b31-e943-432e-ae1a-f4533e31823e tempest-CreateVolumesFromImageTest-1062843527 None] Created volume successfully.
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-e5866059-5f78-489a-a057-4cdf16040c4e-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-e5866059-5f78-489a-a057-4cdf16040c4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-e5866059-5f78-489a-a057-4cdf16040c4e" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e5866059-5f78-489a-a057-4cdf16040c4e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Deleting offline snapshot e5866059-5f78-489a-a057-4cdf16040c4e of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:30 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] snapshot_file for this snap is: volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff 1073741824" returned: 0 in 0.653s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466796f-fef9-4e5b-adf3-b34fb7a9319f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:30 devstack sudo[101925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff
Sep 11 23:14:30 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:30 devstack sudo[101924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e
Sep 11 23:14:30 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:30 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.516s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1950207106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaf13834-c546-47f8-bb1d-62814bf3872c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:27Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Creating volume aaf13834-c546-47f8-bb1d-62814bf3872c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:30 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f64b0479-8c4d-410f-9ba1-4d53fe6ed8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:30 devstack sudo[101929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c 1073741824
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b14e38e-9ad3-4ab7-ab55-fa4430416828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:30 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Volume volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff (91cdaf06-ceb9-46f1-861f-7c9bf18215ff): created successfully
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b14e38e-9ad3-4ab7-ab55-fa4430416828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (d7d75578-2122-470b-aac3-b26889383e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e497a4aa-e112-40a0-af49-c3f94e95dd2a tempest-CreateVolumesFromImageTest-1062843527 None] Created volume successfully.
Sep 11 23:14:30 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e" returned: 0 in 0.473s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bc9433-b153-45df-abd1-cf0eb04ebb30]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:30 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:30 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:30 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c 1073741824" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:30 devstack sudo[101943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c
Sep 11 23:14:30 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:31 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.419s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:31 devstack sudo[101946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e
Sep 11 23:14:31 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:31 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.963s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615672336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf0455c-6594-4b95-a120-39386621b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2262055edf14e46acf78201ee3b1b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:27Z,use_quota=True,user_id='7d4b8da4d3a446119e575fd9df234064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Creating volume 0bf0455c-6594-4b95-a120-39386621b62b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:31 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd341eb-3925-4148-801a-3f12b56a96da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaf13834-c546-47f8-bb1d-62814bf3872c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:31 devstack sudo[101949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b 1073741824
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7a0d96-6350-41e6-92a7-cdd24daeb7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:31 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:31 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Volume volume-aaf13834-c546-47f8-bb1d-62814bf3872c (aaf13834-c546-47f8-bb1d-62814bf3872c): created successfully
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7a0d96-6350-41e6-92a7-cdd24daeb7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (d28b9b2f-6dd1-48f9-8088-1adf7c415f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8ecee546-3b61-4038-acc4-c153a8a95e76 tempest-CreateVolumesFromImageTest-1062843527 None] Created volume successfully.
Sep 11 23:14:31 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e" returned: 0 in 0.511s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:31 devstack sudo[101958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e
Sep 11 23:14:31 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:31 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b 1073741824" returned: 0 in 0.564s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:31 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.e5866059-5f78-489a-a057-4cdf16040c4e" returned: 0 in 0.288s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e5866059-5f78-489a-a057-4cdf16040c4e" released by "_delete_snapshot" :: held 1.815s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" released by "delete_snapshot" :: held 1.843s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:31 devstack sudo[101962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b
Sep 11 23:14:31 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:31 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Created reservations ['6cddc740-dd64-4366-9a62-a716b7a0612e', 'b2898e1a-d80b-4cdf-88e3-2bc33d7c6c52', '05f73e4d-0eb9-48b4-942a-06a536beff76', 'cbf3ded7-8182-4468-a66c-db7397c4dd3a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Delete snapshot completed successfully.
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8411213d-97ec-4998-a948-65ed0e4af6a6 tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-e5866059-5f78-489a-a057-4cdf16040c4e-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:32 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c375a47-863a-4a34-8b59-bec668b7854e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf0455c-6594-4b95-a120-39386621b62b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feb186f-516f-4be0-a73e-c67b9307bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Volume volume-0bf0455c-6594-4b95-a120-39386621b62b (0bf0455c-6594-4b95-a120-39386621b62b): created successfully
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1feb186f-516f-4be0-a73e-c67b9307bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Flow 'volume_create_manager' (c044cba5-5617-4086-8f3e-5f6a7e42283f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-47c8708a-d737-4530-8f06-e80264de9968 tempest-CreateVolumesFromImageTest-1062843527 None] Created volume successfully.
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-5843e2b6-23dd-443f-937b-e18242eb7db6-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-5843e2b6-23dd-443f-937b-e18242eb7db6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-5843e2b6-23dd-443f-937b-e18242eb7db6" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-5843e2b6-23dd-443f-937b-e18242eb7db6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Deleting offline snapshot 5843e2b6-23dd-443f-937b-e18242eb7db6 of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] snapshot_file for this snap is: volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fb7c7d-bab3-40e8-a997-fe53cc3b3c79]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:32 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:32 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:32 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a84b4b-33f8-4d64-b162-da6a7399fed6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-0bf0455c-6594-4b95-a120-39386621b62b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-0bf0455c-6594-4b95-a120-39386621b62b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:32 devstack sudo[101970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:32 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-quobyte-0bf0455c-6594-4b95-a120-39386621b62b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-0bf0455c-6594-4b95-a120-39386621b62b" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c3f12c-eb3f-46e8-9647-33e12190ad3f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:33 devstack sudo[101972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b
Sep 11 23:14:33 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:33 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:33 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:33 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:33 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:33 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b
Sep 11 23:14:33 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:33 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0bf0455c-6594-4b95-a120-39386621b62b" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-0bf0455c-6594-4b95-a120-39386621b62b" released by "delete_volume" :: held 0.709s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:33 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.448s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:33 devstack sudo[101989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6
Sep 11 23:14:33 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Created reservations ['3a217c55-d058-4cbc-9f46-adefea44aa3e', 'dda1d995-6c31-4477-b052-66dc0aa994e1', '54a11afc-acf5-47b9-9836-92b12d6ab5bb', '49ae3f6e-84fe-416a-b81b-132fc125d8b4'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:33 devstack sudo[101991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:33 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:33 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5843e2b6-23dd-443f-937b-e18242eb7db6" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-5843e2b6-23dd-443f-937b-e18242eb7db6" released by "_delete_snapshot" :: held 1.684s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" released by "delete_snapshot" :: held 1.710s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Created reservations ['6deb2244-e608-417e-a70f-70f257f1b579', '90c6cd4b-026d-44d5-95a3-52a30ba1e868', 'a615082b-9d82-4f49-87b2-6dbfeb42673c', 'fd182ba0-889c-44b8-b85b-425119b76d59'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-aaf13834-c546-47f8-bb1d-62814bf3872c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-aaf13834-c546-47f8-bb1d-62814bf3872c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:34 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.321s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Deleted volume successfully.
Sep 11 23:14:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Delete snapshot completed successfully.
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-24e26c76-e610-4394-82be-8f2ce1562aa1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-0bf0455c-6594-4b95-a120-39386621b62b-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-quobyte-aaf13834-c546-47f8-bb1d-62814bf3872c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8c64a51b-ce2c-494a-a5c5-ccdedebca8ec tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-5843e2b6-23dd-443f-937b-e18242eb7db6-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-aaf13834-c546-47f8-bb1d-62814bf3872c" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c20e0a-1aad-4287-908b-ccfc891ff704]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:34 devstack sudo[101995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c
Sep 11 23:14:34 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-5536725b-fc41-458a-99d9-df4f5d770a44-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-5536725b-fc41-458a-99d9-df4f5d770a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-5536725b-fc41-458a-99d9-df4f5d770a44" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-5536725b-fc41-458a-99d9-df4f5d770a44" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Deleting offline snapshot 5536725b-fc41-458a-99d9-df4f5d770a44 of volume e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] snapshot_file for this snap is: volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fc3c3e-1401-4baf-96e0-3c83ebbda13b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:34 devstack sudo[101997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:34 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:34 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:34 devstack sudo[102002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c
Sep 11 23:14:34 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:34 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[107b5a39-ffd4-4a3e-8092-032f83d38c1b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-aaf13834-c546-47f8-bb1d-62814bf3872c" returned: 0 in 0.304s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-aaf13834-c546-47f8-bb1d-62814bf3872c" released by "delete_volume" :: held 0.827s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Created reservations ['fa873472-cd47-4e44-b0be-41eaba0916f8', '1e5a9c38-ba34-4495-92f0-71a091206a15', '5579e6f0-3765-472a-8d28-0da1b9e181c2', '9f7fafe6-b7cf-45e5-8875-15975ce9aa46'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:35 devstack sudo[102008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e
Sep 11 23:14:35 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack sudo[102010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:35 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-91cdaf06-ceb9-46f1-861f-7c9bf18215ff-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-91cdaf06-ceb9-46f1-861f-7c9bf18215ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-quobyte-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:35 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" returned: 0 in 0.505s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92cc829-b8c5-4408-9e5e-604724b86db5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:35 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Flow 'volume_create_manager' (9ec09a8b-311c-4022-82a2-0de4607da269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5577cfea-3efe-4099-af4e-599ab7673140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:35 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5577cfea-3efe-4099-af4e-599ab7673140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134826500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e94d5d-e653-4559-ba0a-0657328c443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b366916547bc4d78a6280d7c63a1867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='19da91ebcceb4216892544f95e420741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee010d8-4045-457c-b727-10302370d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee010d8-4045-457c-b727-10302370d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7722292-cedf-4dc1-8252-3ba61423ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7722292-cedf-4dc1-8252-3ba61423ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e94d5d-e653-4559-ba0a-0657328c443e', 'volume_name': 'volume-63e94d5d-e653-4559-ba0a-0657328c443e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:35 devstack sudo[102016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff
Sep 11 23:14:35 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfba9104-d9f9-4638-a90f-3aa540460455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfba9104-d9f9-4638-a90f-3aa540460455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6fb82-3eec-4090-825e-a2d7a3e31471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Volume 63e94d5d-e653-4559-ba0a-0657328c443e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e94d5d-e653-4559-ba0a-0657328c443e', 'volume_size': 1}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2134826500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e94d5d-e653-4559-ba0a-0657328c443e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b366916547bc4d78a6280d7c63a1867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:36Z,use_quota=True,user_id='19da91ebcceb4216892544f95e420741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Creating volume 63e94d5d-e653-4559-ba0a-0657328c443e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:35 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.510s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:35 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Deleted volume successfully.
Sep 11 23:14:35 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e 1073741824
Sep 11 23:14:35 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-71332906-5acf-4232-a518-53740ac3853d tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-aaf13834-c546-47f8-bb1d-62814bf3872c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:35 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.418s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack sudo[102030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44
Sep 11 23:14:35 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:35 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" returned: 0 in 0.442s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:35 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff
Sep 11 23:14:35 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:36 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e 1073741824" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:36 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e.5536725b-fc41-458a-99d9-df4f5d770a44" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-5536725b-fc41-458a-99d9-df4f5d770a44" released by "_delete_snapshot" :: held 1.771s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:36 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" released by "delete_snapshot" :: held 1.811s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-91cdaf06-ceb9-46f1-861f-7c9bf18215ff" released by "delete_volume" :: held 0.806s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:36 devstack sudo[102039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e
Sep 11 23:14:36 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Created reservations ['e419d978-65cd-4d67-ab2c-483fd693f562', 'c7255336-213f-4549-ad54-349dcd174ec3', 'fae01d76-2975-4aa5-ad52-a52e386d4ccf', '96e700d2-3b67-43e4-9080-7122a3148a33'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Created reservations ['1eca21a4-48c2-4a7b-8596-31e69f179598', '5c6002a0-71eb-4264-9834-ef17dbe6ce92', 'bb81fcbb-78ce-4d14-9f30-99fa6df7926c', 'de113c82-b2c1-4bef-8fd6-b127a779f981'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Delete snapshot completed successfully.
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2099def5-a6f9-4ae0-906d-b255a085217c tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-5536725b-fc41-458a-99d9-df4f5d770a44-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:36 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:36 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:36 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-9820409f-fd82-4cf6-bcc3-e2208a827996-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-9820409f-fd82-4cf6-bcc3-e2208a827996-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6fb82-3eec-4090-825e-a2d7a3e31471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e94d5d-e653-4559-ba0a-0657328c443e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42de289-0ed8-4656-b5d9-cdeb2ae00dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:36 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Volume volume-63e94d5d-e653-4559-ba0a-0657328c443e (63e94d5d-e653-4559-ba0a-0657328c443e): created successfully
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b42de289-0ed8-4656-b5d9-cdeb2ae00dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Flow 'volume_create_manager' (9ec09a8b-311c-4022-82a2-0de4607da269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-e8e34b20-7057-4edd-a943-f4fb1aae0d0e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c2893696-a384-4216-b31e-a202a7e182a3 tempest-VolumesTransfersTest-1601290471 None] Created volume successfully.
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-quobyte-9820409f-fd82-4cf6-bcc3-e2208a827996" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-e8e34b20-7057-4edd-a943-f4fb1aae0d0e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=193,cinder:INSERT=63,cinder:UPDATE=222,cinder:DELETE=14 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-9820409f-fd82-4cf6-bcc3-e2208a827996" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:36 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca3c86-7ca6-4791-be0f-4bc6f99fec02]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Deleted volume successfully.
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c002274c-82fb-4fa0-a0a6-ea3684d753a1 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-91cdaf06-ceb9-46f1-861f-7c9bf18215ff-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c1cfa-65ca-45b8-9a32-c7a5bee6d54c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:36 devstack sudo[102045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996
Sep 11 23:14:36 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack sudo[102046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e
Sep 11 23:14:37 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:37 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996
Sep 11 23:14:37 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:37 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e
Sep 11 23:14:37 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9820409f-fd82-4cf6-bcc3-e2208a827996" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-9820409f-fd82-4cf6-bcc3-e2208a827996" released by "delete_volume" :: held 0.687s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Created reservations ['c7073e64-103a-4b2d-a981-895ddcb48f8a', '5ec0f5bb-1bdf-4160-93a9-cf75deab8475', 'ede8b8a7-eb45-4fd9-9eee-b02eb2e5a1ef', '822be3f6-9624-44fb-82d4-729b24c65c74'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:37 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" returned: 0 in 0.274s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:37 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:37 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-quobyte-e8e34b20-7057-4edd-a943-f4fb1aae0d0e" released by "delete_volume" :: held 0.781s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Created reservations ['59496f69-e657-42bf-8796-a1334a0bf3be', '8d1f654b-2f4f-4213-b87a-a9b562efb3ef', '5886bacf-0d08-4c13-b7b6-c5c625b5ff1f', '61b158f7-fcd6-4b52-9a71-caec0a9174a2'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:37 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:37 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-f0951c29-50f6-4de9-b3d6-40284d125607-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-f0951c29-50f6-4de9-b3d6-40284d125607-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "cinder-quobyte-f0951c29-50f6-4de9-b3d6-40284d125607" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-f0951c29-50f6-4de9-b3d6-40284d125607" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:37 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.434s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Deleted volume successfully.
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3f789-cb7d-4ce9-b668-e9a0d0dbf760]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3fcc5ab8-c354-4630-ae34-91d2492680e6 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-9820409f-fd82-4cf6-bcc3-e2208a827996-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:38 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.363s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Deleted volume successfully.
Sep 11 23:14:38 devstack sudo[102066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607
Sep 11 23:14:38 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c4454fa0-0584-405e-b7a4-fe4282ac72ea tempest-VolumesSnapshotListTestJSON-1969145869 None] Lock "cinder-e8e34b20-7057-4edd-a943-f4fb1aae0d0e-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:38 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607" returned: 0 in 0.439s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:38 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607
Sep 11 23:14:38 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ac4dbd1b-d16c-42dd-9c0a-44e7b991e29c tempest-VolumesTransfersTest-2027199548 None] Transfer volume completed successfully.
Sep 11 23:14:38 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0951c29-50f6-4de9-b3d6-40284d125607" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-quobyte-f0951c29-50f6-4de9-b3d6-40284d125607" released by "delete_volume" :: held 0.814s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Created reservations ['bc4773fb-f08b-429b-bec7-ba99bdea8c01', '1f273714-9e92-4c1d-a608-50d715f00b14', '7a35607f-7446-46aa-893c-8c3e89eaaef4', '22ec6c2e-718e-47cc-ba89-02fa6aaf63ce'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:39 devstack sudo[102077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:39 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:39 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.385s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Deleted volume successfully.
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4c438741-ca0d-47ec-8040-a070c6b51072 tempest-CreateVolumesFromImageTest-1062843527 None] Lock "cinder-f0951c29-50f6-4de9-b3d6-40284d125607-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "cinder-63e94d5d-e653-4559-ba0a-0657328c443e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-63e94d5d-e653-4559-ba0a-0657328c443e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "cinder-quobyte-63e94d5d-e653-4559-ba0a-0657328c443e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-quobyte-63e94d5d-e653-4559-ba0a-0657328c443e" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf1ac2-750a-4412-bcff-666594764dea]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:39 devstack sudo[102080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e
Sep 11 23:14:39 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:40 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e" returned: 0 in 0.475s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:40 devstack sudo[102086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e
Sep 11 23:14:40 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:40 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-63e94d5d-e653-4559-ba0a-0657328c443e" returned: 0 in 0.293s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-quobyte-63e94d5d-e653-4559-ba0a-0657328c443e" released by "delete_volume" :: held 0.842s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Created reservations ['c3d35d5b-eeed-41dd-bad2-525e3f41852b', 'f4d90942-f6a7-4d85-a3e9-39ab8456bad3', '4b1061fb-f2aa-4f4b-af5b-765ce4418e54', '070c20b7-c52b-4926-afac-6e5cf9788fcd'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:40 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:40 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:41 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.283s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:41 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Deleted volume successfully.
Sep 11 23:14:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0d3aa157-1dc8-45df-9bdb-15506e9d9eb4 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-63e94d5d-e653-4559-ba0a-0657328c443e-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=249,cinder:SELECT=192,cinder:DELETE=24,cinder:INSERT=58 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Flow 'volume_create_manager' (fea0167f-ab62-4dd4-85d9-e2d909df0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161a9f62-635e-4991-8316-e8e8dca3875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161a9f62-635e-4991-8316-e8e8dca3875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1838531495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d40897b-2a63-4bad-8e01-80d303a3c9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b366916547bc4d78a6280d7c63a1867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='19da91ebcceb4216892544f95e420741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ef64d-0eb6-457a-aed6-63cbf9516055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0ef64d-0eb6-457a-aed6-63cbf9516055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21972c00-93a7-4907-8f07-01d854652b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21972c00-93a7-4907-8f07-01d854652b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d40897b-2a63-4bad-8e01-80d303a3c9e9', 'volume_name': 'volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8a893d-0a45-4246-a5f5-d36e55e014b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8a893d-0a45-4246-a5f5-d36e55e014b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9977ca0-f9ab-4a7a-977b-3111f65e0187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:42 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Volume 0d40897b-2a63-4bad-8e01-80d303a3c9e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9', 'volume_size': 1}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1838531495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d40897b-2a63-4bad-8e01-80d303a3c9e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b366916547bc4d78a6280d7c63a1867b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='19da91ebcceb4216892544f95e420741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Creating volume 0d40897b-2a63-4bad-8e01-80d303a3c9e9 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:42 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:42 devstack sudo[102094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 1073741824
Sep 11 23:14:42 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Flow 'volume_create_manager' (b09d2b84-56d6-4f17-86f3-0c72022610a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c78fd4b-01a5-4a6a-9d63-30d6d8bcfc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c78fd4b-01a5-4a6a-9d63-30d6d8bcfc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-494502054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd541d-d82d-4b61-b730-2588a7d1deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4da644fd814eb483d7bb54afb852ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='66c411d175c84d7dab809f687f083c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ad7a18-7386-41c4-a0a0-4506f0af30f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ad7a18-7386-41c4-a0a0-4506f0af30f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0359a22-8a15-48ab-b467-1068e3e2ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0359a22-8a15-48ab-b467-1068e3e2ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dd541d-d82d-4b61-b730-2588a7d1deb2', 'volume_name': 'volume-45dd541d-d82d-4b61-b730-2588a7d1deb2', 'volume_size': 2}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf155da-1762-47df-88fc-a6e695be9ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf155da-1762-47df-88fc-a6e695be9ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e392f8-e90f-4a7f-88c4-6403cdd6699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Volume 45dd541d-d82d-4b61-b730-2588a7d1deb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dd541d-d82d-4b61-b730-2588a7d1deb2', 'volume_size': 2}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:43 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 1073741824" returned: 0 in 0.588s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:43 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9
Sep 11 23:14:43 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:43 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-494502054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd541d-d82d-4b61-b730-2588a7d1deb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c4da644fd814eb483d7bb54afb852ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:43Z,use_quota=True,user_id='66c411d175c84d7dab809f687f083c69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Creating volume 45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:43 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 2147483648 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:43 devstack sudo[102103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 2147483648
Sep 11 23:14:43 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9977ca0-f9ab-4a7a-977b-3111f65e0187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b603fc08-77a6-4411-b33e-f2b626b6b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Volume volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 (0d40897b-2a63-4bad-8e01-80d303a3c9e9): created successfully
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b603fc08-77a6-4411-b33e-f2b626b6b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Flow 'volume_create_manager' (fea0167f-ab62-4dd4-85d9-e2d909df0129) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c57e56e1-611b-4f3f-af54-d5aa7d21ba2a tempest-VolumesTransfersTest-1601290471 None] Created volume successfully.
Sep 11 23:14:44 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 2147483648" returned: 0 in 0.549s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:44 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2
Sep 11 23:14:44 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:44 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2e392f8-e90f-4a7f-88c4-6403cdd6699c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd541d-d82d-4b61-b730-2588a7d1deb2', 'volume_size': 2}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843d0622-7e37-463c-8aef-168342ed7cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:44 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Volume volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 (45dd541d-d82d-4b61-b730-2588a7d1deb2): created successfully
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843d0622-7e37-463c-8aef-168342ed7cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Flow 'volume_create_manager' (b09d2b84-56d6-4f17-86f3-0c72022610a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-00108654-6da0-4107-9fdb-7105e5dfa173 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Created volume successfully.
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "cinder-0d40897b-2a63-4bad-8e01-80d303a3c9e9-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-0d40897b-2a63-4bad-8e01-80d303a3c9e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "cinder-quobyte-0d40897b-2a63-4bad-8e01-80d303a3c9e9" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-quobyte-0d40897b-2a63-4bad-8e01-80d303a3c9e9" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5390edf9-747b-4f0e-a3a5-02954ef43f07]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:45 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9
Sep 11 23:14:45 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Creating offline snapshot bc5585e6-75c1-48e8-bf88-ffbe9af740b3 of volume 45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c46ad7c-b23a-42a0-9337-631428ac6e25]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:45 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9" returned: 0 in 0.452s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:45 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9
Sep 11 23:14:45 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:45 devstack sudo[102115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2
Sep 11 23:14:45 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:45 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d40897b-2a63-4bad-8e01-80d303a3c9e9" returned: 0 in 0.280s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-quobyte-0d40897b-2a63-4bad-8e01-80d303a3c9e9" released by "delete_volume" :: held 0.790s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:45 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 2G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:45 devstack sudo[102127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 2G
Sep 11 23:14:45 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:45 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Created reservations ['b83fe9fd-3dc6-470d-9934-73f3c0a86c30', 'c086a76e-dc49-4ae4-a4ac-4d7803e0452c', '1f9d2cbe-834f-41c6-aaeb-dde0f2c0485f', '72269538-370f-47a9-9506-f184f21dd70f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:46 devstack sudo[102129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:46 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:46 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:46 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:46 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:14:46 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.346s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:46 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Deleted volume successfully.
Sep 11 23:14:46 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 2G" returned: 0 in 0.632s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:46 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3
Sep 11 23:14:46 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-eea1cb05-8523-4e1b-981b-a65ee386c4c5 tempest-VolumesTransfersTest-111595419 None] Lock "cinder-0d40897b-2a63-4bad-8e01-80d303a3c9e9-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:46 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3" returned: 0 in 0.329s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:46 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 is being set with open permissions: ugo+rw
Sep 11 23:14:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:46 devstack sudo[102144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3
Sep 11 23:14:46 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:47 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3" returned: 0 in 0.285s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:47 devstack sudo[102147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info
Sep 11 23:14:47 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:47 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:47 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info is being set with open permissions: ugo+rw
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:47 devstack sudo[102150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info
Sep 11 23:14:47 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:47 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.info" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.278s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7d664c45-60b1-4c7f-9f4f-94de53a477dd tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Create snapshot completed successfully
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "cinder-bc5585e6-75c1-48e8-bf88-ffbe9af740b3-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-bc5585e6-75c1-48e8-bf88-ffbe9af740b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "cinder-quobyte-bc5585e6-75c1-48e8-bf88-ffbe9af740b3" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-bc5585e6-75c1-48e8-bf88-ffbe9af740b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Deleting offline snapshot bc5585e6-75c1-48e8-bf88-ffbe9af740b3 of volume 45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] snapshot_file for this snap is: volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34859fc-6e3b-41f3-be88-782d63af4399]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:48 devstack sudo[102153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3
Sep 11 23:14:48 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:49 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3" returned: 0 in 0.452s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd541d-d82d-4b61-b730-2588a7d1deb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[518f3ffc-248f-40fd-8eb4-699dc6f009b6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:49 devstack sudo[102158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2
Sep 11 23:14:49 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:49 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:49 devstack sudo[102165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3
Sep 11 23:14:49 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:50 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:50 devstack sudo[102170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3
Sep 11 23:14:50 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:50 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2.bc5585e6-75c1-48e8-bf88-ffbe9af740b3" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-bc5585e6-75c1-48e8-bf88-ffbe9af740b3" released by "_delete_snapshot" :: held 1.718s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" released by "delete_snapshot" :: held 1.744s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Created reservations ['68f1856c-7801-42de-9ef6-ef5a49713e5d', '80c15322-b78a-4fd0-8941-f7dbd2ff4d91', '2c06ab62-b41a-4344-860e-3f934d6a6921', '45c8b930-b6ec-47b3-b1f3-7fffa46d6556'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Delete snapshot completed successfully.
Sep 11 23:14:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-37859ae2-82c9-461c-804d-052c8570df33 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-bc5585e6-75c1-48e8-bf88-ffbe9af740b3-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "cinder-45dd541d-d82d-4b61-b730-2588a7d1deb2-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-45dd541d-d82d-4b61-b730-2588a7d1deb2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20cd80-26fb-4c52-8468-72502704cac8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:51 devstack sudo[102173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2
Sep 11 23:14:51 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:51 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2" returned: 0 in 0.430s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:51 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2
Sep 11 23:14:51 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:51 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-45dd541d-d82d-4b61-b730-2588a7d1deb2" returned: 0 in 0.308s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-quobyte-45dd541d-d82d-4b61-b730-2588a7d1deb2" released by "delete_volume" :: held 0.828s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Created reservations ['a1766cd7-3836-4027-98b6-73cae9cb0de5', 'e3234d76-7af4-41a1-b6cd-c4b274d47c41', 'a9f44663-23be-4234-85aa-2553f82ccb9c', 'cec2f2f4-b960-4b9d-a04c-5f9b86905209'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:52 devstack sudo[102181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:14:52 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:52 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:14:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Deleted volume successfully.
Sep 11 23:14:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2ce86ea7-b255-4066-aa21-15dbf38f54c7 tempest-VolumesSnapshotNegativeTestJSON-1872053734 None] Lock "cinder-45dd541d-d82d-4b61-b730-2588a7d1deb2-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (d899b3a2-ff3c-4d86-9d5f-3117045465be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ee316-3c98-4350-8022-65975d7a1238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6ee316-3c98-4350-8022-65975d7a1238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2045669995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd0c366-491f-4c1e-b0b3-86becec0a664,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:54Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30e1084-658c-49f2-b80c-4d3d75121430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30e1084-658c-49f2-b80c-4d3d75121430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12ee4f2-e2b9-4b9b-b818-dc3270ab7f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b12ee4f2-e2b9-4b9b-b818-dc3270ab7f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd0c366-491f-4c1e-b0b3-86becec0a664', 'volume_name': 'volume-ddd0c366-491f-4c1e-b0b3-86becec0a664', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bb7532-1670-4e80-90d0-66428ef5b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bb7532-1670-4e80-90d0-66428ef5b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa8b91a-bb0a-4e60-8f39-6c8ce1b5de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:54 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Volume ddd0c366-491f-4c1e-b0b3-86becec0a664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd0c366-491f-4c1e-b0b3-86becec0a664', 'volume_size': 1}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2045669995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd0c366-491f-4c1e-b0b3-86becec0a664,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:54Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Creating volume ddd0c366-491f-4c1e-b0b3-86becec0a664 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:54 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:54 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 1073741824
Sep 11 23:14:54 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:55 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 1073741824" returned: 0 in 0.612s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:55 devstack sudo[102190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664
Sep 11 23:14:55 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:55 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664" returned: 0 in 0.327s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fa8b91a-bb0a-4e60-8f39-6c8ce1b5de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd0c366-491f-4c1e-b0b3-86becec0a664', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6239c1-3ca2-4d7b-a6a0-3aa38e5aff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:55 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Volume volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 (ddd0c366-491f-4c1e-b0b3-86becec0a664): created successfully
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6239c1-3ca2-4d7b-a6a0-3aa38e5aff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (d899b3a2-ff3c-4d86-9d5f-3117045465be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-33f32428-97dd-496b-9392-f00e6a79db5e tempest-VolumesListTestJSON-180051834 None] Created volume successfully.
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (9d81229d-6ede-4940-9114-06eebedd7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491744c7-6c52-43c7-833b-e7b4105309a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491744c7-6c52-43c7-833b-e7b4105309a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1080518769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93424dc5-e090-4865-b016-6d2a172b8c8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:57Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f486d8-e28a-4ab7-9d3c-b230f584eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f486d8-e28a-4ab7-9d3c-b230f584eb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d845a3c3-a334-4ed2-b0cc-1649980d7edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d845a3c3-a334-4ed2-b0cc-1649980d7edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93424dc5-e090-4865-b016-6d2a172b8c8f', 'volume_name': 'volume-93424dc5-e090-4865-b016-6d2a172b8c8f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4a91c3-8df4-45e7-ad21-460dd7c27902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4a91c3-8df4-45e7-ad21-460dd7c27902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf87df91-0887-4e72-bebf-06b3abe87d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:57 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Volume 93424dc5-e090-4865-b016-6d2a172b8c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93424dc5-e090-4865-b016-6d2a172b8c8f', 'volume_size': 1}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1080518769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93424dc5-e090-4865-b016-6d2a172b8c8f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:14:57Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Creating volume 93424dc5-e090-4865-b016-6d2a172b8c8f {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:14:57 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:57 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f 1073741824
Sep 11 23:14:57 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:57 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f 1073741824" returned: 0 in 0.524s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:14:58 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f
Sep 11 23:14:58 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:14:58 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f" returned: 0 in 0.301s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf87df91-0887-4e72-bebf-06b3abe87d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93424dc5-e090-4865-b016-6d2a172b8c8f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de2fe57-7c81-4309-9204-067808fe8773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:14:58 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Volume volume-93424dc5-e090-4865-b016-6d2a172b8c8f (93424dc5-e090-4865-b016-6d2a172b8c8f): created successfully
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de2fe57-7c81-4309-9204-067808fe8773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:14:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (9d81229d-6ede-4940-9114-06eebedd7254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:14:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3f0c5a50-69ba-4bbe-8bb0-a9cc43497bf7 tempest-VolumesListTestJSON-180051834 None] Created volume successfully.
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (28f24fe1-f985-4e67-9a66-fc3afc0062d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6693b07f-2fd4-4f9c-a5cb-5c5533e5f1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6693b07f-2fd4-4f9c-a5cb-5c5533e5f1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1726466872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe61c447-f371-4a92-9ab3-1eadc96d0b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:00Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea480c0-88a7-40dc-ba9f-a72104f88d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ea480c0-88a7-40dc-ba9f-a72104f88d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70627853-857f-4ccb-aea2-170173b03954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70627853-857f-4ccb-aea2-170173b03954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe61c447-f371-4a92-9ab3-1eadc96d0b70', 'volume_name': 'volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94583d3-6824-49cb-8b09-68e49620f67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94583d3-6824-49cb-8b09-68e49620f67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823c8bf4-6ae7-4e02-9225-5523794e2cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Volume fe61c447-f371-4a92-9ab3-1eadc96d0b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70', 'volume_size': 1}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1726466872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe61c447-f371-4a92-9ab3-1eadc96d0b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82fb40a8b1d348aca6a649f36a3a2f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:00Z,use_quota=True,user_id='c31100dbffc345c6bc9545c4957095a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Creating volume fe61c447-f371-4a92-9ab3-1eadc96d0b70 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:00 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:00 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 1073741824
Sep 11 23:15:00 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:00 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 1073741824" returned: 0 in 0.499s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:00 devstack sudo[102212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70
Sep 11 23:15:00 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:01 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823c8bf4-6ae7-4e02-9225-5523794e2cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d129976a-604c-495f-b774-a95273e90790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Volume volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 (fe61c447-f371-4a92-9ab3-1eadc96d0b70): created successfully
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d129976a-604c-495f-b774-a95273e90790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Flow 'volume_create_manager' (28f24fe1-f985-4e67-9a66-fc3afc0062d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c940cc04-e1d3-45ad-8098-5be4fcceb083 tempest-VolumesListTestJSON-180051834 None] Created volume successfully.
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-fe61c447-f371-4a92-9ab3-1eadc96d0b70-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "cinder-fe61c447-f371-4a92-9ab3-1eadc96d0b70-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-quobyte-fe61c447-f371-4a92-9ab3-1eadc96d0b70" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-fe61c447-f371-4a92-9ab3-1eadc96d0b70" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3317fc29-4f24-441b-8e86-90b23f9069e7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:05 devstack sudo[102220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70
Sep 11 23:15:05 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:05 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:05 devstack sudo[102226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70
Sep 11 23:15:05 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:05 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-fe61c447-f371-4a92-9ab3-1eadc96d0b70" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-fe61c447-f371-4a92-9ab3-1eadc96d0b70" released by "delete_volume" :: held 0.839s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Created reservations ['888d2311-0793-4bea-a295-6cd010fad174', '6d467f6b-f6f8-4c67-9319-e1f5ba0cda65', '82ffabea-74d8-4ef6-b761-45e8a3ea78a9', '078733d3-02db-4e6c-ad88-32add54e5a43'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:06 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:06 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-93424dc5-e090-4865-b016-6d2a172b8c8f-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:06 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "cinder-93424dc5-e090-4865-b016-6d2a172b8c8f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Deleted volume successfully.
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-quobyte-93424dc5-e090-4865-b016-6d2a172b8c8f" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d4557898-2ce7-4ea2-8ffb-9cf1184568ee tempest-VolumesListTestJSON-180051834 None] Lock "cinder-fe61c447-f371-4a92-9ab3-1eadc96d0b70-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-93424dc5-e090-4865-b016-6d2a172b8c8f" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b2725-1fb1-4090-b8f1-701e33c0e9dc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:06 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f
Sep 11 23:15:06 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:07 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f" returned: 0 in 0.472s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:07 devstack sudo[102237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f
Sep 11 23:15:07 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:07 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93424dc5-e090-4865-b016-6d2a172b8c8f" returned: 0 in 0.274s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-93424dc5-e090-4865-b016-6d2a172b8c8f" released by "delete_volume" :: held 0.795s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Created reservations ['7b093e71-9922-4114-9c38-394e93be25b9', '8a1a58bc-406a-48cb-8cf3-0819c15675db', '8dd4284a-8cbf-4a6c-9e0c-b75316e26ce3', '3bfce90e-4b58-408f-9aa8-504b55fedc69'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:07 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:07 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-ddd0c366-491f-4c1e-b0b3-86becec0a664-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "cinder-ddd0c366-491f-4c1e-b0b3-86becec0a664-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Acquiring lock "cinder-quobyte-ddd0c366-491f-4c1e-b0b3-86becec0a664" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-ddd0c366-491f-4c1e-b0b3-86becec0a664" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d148add-1fe1-494c-9bff-6b99fefc6918]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:07 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.369s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Deleted volume successfully.
Sep 11 23:15:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-95bbba83-65bf-4046-a74f-4a5a4bbdcd43 tempest-VolumesListTestJSON-180051834 None] Lock "cinder-93424dc5-e090-4865-b016-6d2a172b8c8f-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:07 devstack sudo[102243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664
Sep 11 23:15:07 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:08 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664" returned: 0 in 0.408s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:08 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664
Sep 11 23:15:08 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:08 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ddd0c366-491f-4c1e-b0b3-86becec0a664" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "cinder-quobyte-ddd0c366-491f-4c1e-b0b3-86becec0a664" released by "delete_volume" :: held 0.744s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Created reservations ['b0b2d44c-fb60-41ea-b6fd-76d4e7f8a256', 'ca902386-7cb5-4a4e-81ad-d2c2b1e77239', '366c61b5-0e0f-4fc6-9a9f-e984feef8565', '60b1e52b-7f20-4d22-8140-b9b06660a139'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:08 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:08 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:08 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.326s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:08 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Deleted volume successfully.
Sep 11 23:15:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9c0a58d8-c97a-47d6-9055-7ca5357a2e2a tempest-VolumesListTestJSON-180051834 None] Lock "cinder-ddd0c366-491f-4c1e-b0b3-86becec0a664-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=40,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=13 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Flow 'volume_create_manager' (2773432e-236f-42c0-9e79-2529dd763751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1ba97-4102-4cce-816d-a8b6d9741e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a1ba97-4102-4cce-816d-a8b6d9741e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-434812687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967e2538-477f-4d44-b508-b6733ebbb416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e7b057675b46589deade3651d6da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:19Z,use_quota=True,user_id='b9fa88d6d2664ef7be680b021463440d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286b847c-a8f5-4008-9081-5939b2b0002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286b847c-a8f5-4008-9081-5939b2b0002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1a0e2d-c25d-459e-b8bd-6b840b3bd47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1a0e2d-c25d-459e-b8bd-6b840b3bd47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '967e2538-477f-4d44-b508-b6733ebbb416', 'volume_name': 'volume-967e2538-477f-4d44-b508-b6733ebbb416', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0e6095-2bcc-431f-8743-6ff53fedc2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0e6095-2bcc-431f-8743-6ff53fedc2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85eaa014-076d-47d9-90aa-b7170d15f861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Volume 967e2538-477f-4d44-b508-b6733ebbb416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-967e2538-477f-4d44-b508-b6733ebbb416', 'volume_size': 1}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-434812687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=967e2538-477f-4d44-b508-b6733ebbb416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e7b057675b46589deade3651d6da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:19Z,use_quota=True,user_id='b9fa88d6d2664ef7be680b021463440d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Creating volume 967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:19 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:19 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 1073741824
Sep 11 23:15:19 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:19 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 1073741824" returned: 0 in 0.484s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:19 devstack sudo[102299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:19 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:19 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.320s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85eaa014-076d-47d9-90aa-b7170d15f861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-967e2538-477f-4d44-b508-b6733ebbb416', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828d3d0d-a7ce-455d-8b09-bcfe081de8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Volume volume-967e2538-477f-4d44-b508-b6733ebbb416 (967e2538-477f-4d44-b508-b6733ebbb416): created successfully
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (828d3d0d-a7ce-455d-8b09-bcfe081de8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Flow 'volume_create_manager' (2773432e-236f-42c0-9e79-2529dd763751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-75ce31b1-8878-4ff6-8254-439fa6b50782 tempest-SnapshotDependencyTests-1916056466 None] Created volume successfully.
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Creating offline snapshot b9c84f26-239e-40b4-bfc9-98b98d37eaaa of volume 967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c952a8-13bb-4156-9e83-d0c26eed9b48]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:21 devstack sudo[102302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:21 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:21 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:21 devstack sudo[102307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa 1G
Sep 11 23:15:21 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:22 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa 1G" returned: 0 in 0.514s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e2538-477f-4d44-b508-b6733ebbb416 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:22 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e2538-477f-4d44-b508-b6733ebbb416 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:22 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:22 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-967e2538-477f-4d44-b508-b6733ebbb416 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.368s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:22 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa is being set with open permissions: ugo+rw
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:22 devstack sudo[102318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:22 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:22 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:22 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info
Sep 11 23:15:22 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:23 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:23 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info is being set with open permissions: ugo+rw
Sep 11 23:15:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:23 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info
Sep 11 23:15:23 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:23 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.info" returned: 0 in 0.314s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.303s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-92d6df45-7bdd-49c7-ba1d-61a84dd1a949 tempest-SnapshotDependencyTests-1916056466 None] Create snapshot completed successfully
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Flow 'volume_create_manager' (3e850bcf-3fd5-49f5-b601-9bfa695bf6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d079460-0412-49d0-891d-532371e7621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d079460-0412-49d0-891d-532371e7621e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0e96fa-cc97-435a-90e1-d2e5dcf81817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07e7b057675b46589deade3651d6da3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9c84f26-239e-40b4-bfc9-98b98d37eaaa,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:25Z,use_quota=True,user_id='b9fa88d6d2664ef7be680b021463440d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48f43e9-b7d2-486e-acc9-58a541a73fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48f43e9-b7d2-486e-acc9-58a541a73fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac61134e-d443-4ddf-9664-e04cc13addd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac61134e-d443-4ddf-9664-e04cc13addd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b0e96fa-cc97-435a-90e1-d2e5dcf81817', 'volume_name': 'volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817', 'volume_size': 1, 'snapshot_id': 'b9c84f26-239e-40b4-bfc9-98b98d37eaaa'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51d11e-83f8-49d8-baca-d1276b0b3b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51d11e-83f8-49d8-baca-d1276b0b3b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d582d8-f5e5-4ed7-9bcc-68609ccabe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Volume 6b0e96fa-cc97-435a-90e1-d2e5dcf81817: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817', 'volume_size': 1, 'snapshot_id': 'b9c84f26-239e-40b4-bfc9-98b98d37eaaa'}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Creating volume 6b0e96fa-cc97-435a-90e1-d2e5dcf81817 from snapshot b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] snapshot: b9c84f26-239e-40b4-bfc9-98b98d37eaaa, volume: 6b0e96fa-cc97-435a-90e1-d2e5dcf81817,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01fed7b-990d-4350-9d02-265a84b80706]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:25 devstack sudo[102333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:25 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:25 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.451s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967e2538-477f-4d44-b508-b6733ebbb416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7d7851-a4ee-465a-bc40-281745583ed8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:26 devstack sudo[102339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:26 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:26 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.472s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:15:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:15:26 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:15:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:26 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817
Sep 11 23:15:26 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:32 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" returned: 0 in 5.622s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416, size 1024.00 MB, duration 5.62 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:15:32 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Converted 1024.00 MB image at 182.10 MB/s
Sep 11 23:15:32 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 is being set with open permissions: ugo+rw
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:32 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817
Sep 11 23:15:32 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:32 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" released by "_copy_volume_from_snapshot" :: held 6.903s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" released by "_create_volume_from_snapshot" :: held 6.985s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d582d8-f5e5-4ed7-9bcc-68609ccabe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817', 'volume_size': 1, 'snapshot_id': 'b9c84f26-239e-40b4-bfc9-98b98d37eaaa'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc7f01b-26fc-4769-8e5f-f4b8cdec69d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Volume volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 (6b0e96fa-cc97-435a-90e1-d2e5dcf81817): created successfully
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc7f01b-26fc-4769-8e5f-f4b8cdec69d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Flow 'volume_create_manager' (3e850bcf-3fd5-49f5-b601-9bfa695bf6d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10205f80-f14c-4f89-99ed-490c5ce7f30f tempest-SnapshotDependencyTests-1916056466 None] Created volume successfully.
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Deleting offline snapshot b9c84f26-239e-40b4-bfc9-98b98d37eaaa of volume 967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] snapshot_file for this snap is: volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[198b5eb1-be5e-4c6f-94f4-91dc93224ff1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:33 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:33 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:33 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-967e2538-477f-4d44-b508-b6733ebbb416(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb62ae0-1e20-4570-be49-ae485a75ed79]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:33 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:33 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:34 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.652s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:34 devstack sudo[102373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:34 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:34 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.384s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:34 devstack sudo[102378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa
Sep 11 23:15:34 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:34 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416.b9c84f26-239e-40b4-bfc9-98b98d37eaaa" returned: 0 in 0.285s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-b9c84f26-239e-40b4-bfc9-98b98d37eaaa" released by "_delete_snapshot" :: held 1.856s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" released by "delete_snapshot" :: held 1.882s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Created reservations ['22e3cf7a-f578-46c4-b6c5-1d19a8d3525d', 'a2ea30fc-c230-42ad-a48f-2481458658dd', '1d146fa9-fd9f-4900-adc9-599d176e61e1', '9ed8112b-890f-44f8-8867-37a21551eaca'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:35 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Delete snapshot completed successfully.
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d62bdab5-07e5-4926-870e-15296b5d9734 tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-b9c84f26-239e-40b4-bfc9-98b98d37eaaa-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-967e2538-477f-4d44-b508-b6733ebbb416-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-967e2538-477f-4d44-b508-b6733ebbb416-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2325f-90a5-4e03-a096-13ec48fc130e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:35 devstack sudo[102381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:35 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:35 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:35 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416
Sep 11 23:15:35 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:36 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-967e2538-477f-4d44-b508-b6733ebbb416" returned: 0 in 0.437s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-967e2538-477f-4d44-b508-b6733ebbb416" released by "delete_volume" :: held 0.950s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Created reservations ['7c48d08c-3499-4388-87b6-e8e299af83e9', '8a958824-f5bb-4b2d-bb3f-506f833570c6', 'cc89967c-47d3-49a5-b786-656d2405901b', '5b548029-43d1-409b-bbb9-d08cba55d493'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:36 devstack sudo[102405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:36 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:36 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Deleted volume successfully.
Sep 11 23:15:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=82,cinder:INSERT=32,cinder:UPDATE=109,cinder:DELETE=11 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b9e3498e-07b5-4e94-919f-1c1df613f10f tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-967e2538-477f-4d44-b508-b6733ebbb416-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-6b0e96fa-cc97-435a-90e1-d2e5dcf81817-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-6b0e96fa-cc97-435a-90e1-d2e5dcf81817-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbbff6e-17b0-4a2e-b846-87bd0d619b60]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:37 devstack sudo[102408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817
Sep 11 23:15:37 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:38 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" returned: 0 in 0.448s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:38 devstack sudo[102415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817
Sep 11 23:15:38 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:38 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" returned: 0 in 0.288s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-quobyte-6b0e96fa-cc97-435a-90e1-d2e5dcf81817" released by "delete_volume" :: held 0.799s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Created reservations ['cc830d71-8aae-4c27-ba1d-a260b7982cb7', '07437037-331d-425d-9c4b-076e65fb045a', 'b402fb46-ddaa-4337-a447-afe6c06ce21d', '7745be58-e379-43f1-a12b-3fd667aff62b'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:38 devstack sudo[102430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:38 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:39 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.520s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:39 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Deleted volume successfully.
Sep 11 23:15:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d9e711eb-a9a2-4e7f-8ec0-36e24dff80fc tempest-SnapshotDependencyTests-1916056466 None] Lock "cinder-6b0e96fa-cc97-435a-90e1-d2e5dcf81817-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:46 devstack sudo[102496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:15:46 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:46 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.337s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:15:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (c581f742-c96b-47a5-9c7d-56027c8a3bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49ed38b-d79d-48b5-9cbe-3e9d857766d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49ed38b-d79d-48b5-9cbe-3e9d857766d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-334583203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec06117-07ff-4ede-b808-37de1cd8d091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:49Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d704384-7350-4d15-a819-8c4856629772),volume_type_id=2d704384-7350-4d15-a819-8c4856629772)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5853c46-a7a9-419b-bc96-52a9f8b2896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5853c46-a7a9-419b-bc96-52a9f8b2896b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eb3309-7ac8-4cd4-ae2a-20bad71047f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30eb3309-7ac8-4cd4-ae2a-20bad71047f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec06117-07ff-4ede-b808-37de1cd8d091', 'volume_name': 'volume-1ec06117-07ff-4ede-b808-37de1cd8d091', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f3c3f-f70e-4f49-ae12-a40aec8410cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f3c3f-f70e-4f49-ae12-a40aec8410cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b4654b-afe5-4f73-8a8a-e2d0a0fe2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:48 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume 1ec06117-07ff-4ede-b808-37de1cd8d091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec06117-07ff-4ede-b808-37de1cd8d091', 'volume_size': 1}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-334583203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec06117-07ff-4ede-b808-37de1cd8d091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:49Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d704384-7350-4d15-a819-8c4856629772),volume_type_id=2d704384-7350-4d15-a819-8c4856629772)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Creating volume 1ec06117-07ff-4ede-b808-37de1cd8d091 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:48 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:15:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:48 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 1073741824
Sep 11 23:15:48 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:49 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (f5a2dd2d-c09a-48bf-9512-a78bb7a24495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a8e54-46cf-4a7d-b5bb-a3813735f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 1073741824" returned: 0 in 0.657s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0a8e54-46cf-4a7d-b5bb-a3813735f972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880728523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013a35f-8b1a-4ef9-93f2-bab020a8cd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:49Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab7e7456-4501-499f-831e-704f480e12aa),volume_type_id=ab7e7456-4501-499f-831e-704f480e12aa)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aede8051-bf73-48c0-b183-60142b39f959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aede8051-bf73-48c0-b183-60142b39f959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5da3a-7f50-4889-b874-58b79f8cf38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa5da3a-7f50-4889-b874-58b79f8cf38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6013a35f-8b1a-4ef9-93f2-bab020a8cd29', 'volume_name': 'volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3145c168-234f-48c8-a97f-cd6370280674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3145c168-234f-48c8-a97f-cd6370280674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25acf91-4ecb-4ef2-91b1-d46e9b3ae5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:49 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume 6013a35f-8b1a-4ef9-93f2-bab020a8cd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29', 'volume_size': 1}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:49 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091
Sep 11 23:15:49 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:50 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.394s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1880728523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013a35f-8b1a-4ef9-93f2-bab020a8cd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:49Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab7e7456-4501-499f-831e-704f480e12aa),volume_type_id=ab7e7456-4501-499f-831e-704f480e12aa)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Creating volume 6013a35f-8b1a-4ef9-93f2-bab020a8cd29 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:50 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b4654b-afe5-4f73-8a8a-e2d0a0fe2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec06117-07ff-4ede-b808-37de1cd8d091', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752775e6-5402-4742-8724-df01f2f8edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack sudo[102511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 1073741824
Sep 11 23:15:50 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume volume-1ec06117-07ff-4ede-b808-37de1cd8d091 (1ec06117-07ff-4ede-b808-37de1cd8d091): created successfully
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752775e6-5402-4742-8724-df01f2f8edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (c581f742-c96b-47a5-9c7d-56027c8a3bf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c0f0a5b6-db3c-4826-904f-46c966347137 tempest-TestInstancesWithCinderVolumes-849661769 None] Created volume successfully.
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (4c41bf04-8c4c-4de9-91b2-e2e774635998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f1c35e-ffe6-4f05-9401-7b87c63c2505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f1c35e-ffe6-4f05-9401-7b87c63c2505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2110746387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c22690-0d24-4f5c-a313-e9cf9900e68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:50Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd4260b8-d92c-4d37-b781-1166fddff246),volume_type_id=fd4260b8-d92c-4d37-b781-1166fddff246)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3052c105-51ff-4b59-a762-9e6e1d7e81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3052c105-51ff-4b59-a762-9e6e1d7e81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd06ba-3d4f-4906-b87a-af20094324b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:15:50 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 1073741824" returned: 0 in 0.664s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:50 devstack sudo[102517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29
Sep 11 23:15:50 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd06ba-3d4f-4906-b87a-af20094324b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96c22690-0d24-4f5c-a313-e9cf9900e68c', 'volume_name': 'volume-96c22690-0d24-4f5c-a313-e9cf9900e68c', 'volume_size': 1, 'image_id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1047659693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '415264fc13e1419d970222e60529bd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'created_at': datetime.datetime(2026, 9, 11, 21, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bff82cbf-263a-48e8-8001-6d21dac3df6f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63f7b00>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94226152-1864-4d44-9ad3-7dc093d8313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94226152-1864-4d44-9ad3-7dc093d8313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a335820-c743-4683-87fb-8a34718c33cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume 96c22690-0d24-4f5c-a313-e9cf9900e68c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96c22690-0d24-4f5c-a313-e9cf9900e68c', 'volume_size': 1, 'image_id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1047659693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '415264fc13e1419d970222e60529bd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'created_at': datetime.datetime(2026, 9, 11, 21, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bff82cbf-263a-48e8-8001-6d21dac3df6f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63f7b00>}
Sep 11 23:15:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Trying to clone 96c22690-0d24-4f5c-a313-e9cf9900e68c from image bff82cbf-263a-48e8-8001-6d21dac3df6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:15:51 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25acf91-4ecb-4ef2-91b1-d46e9b3ae5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7268a3-6012-4a08-a0fa-2f6f7f166343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 (6013a35f-8b1a-4ef9-93f2-bab020a8cd29): created successfully
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7268a3-6012-4a08-a0fa-2f6f7f166343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (f5a2dd2d-c09a-48bf-9512-a78bb7a24495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-dc77e806-0698-41c3-9ca3-e0fbfe525d59 tempest-TestInstancesWithCinderVolumes-849661769 None] Created volume successfully.
Sep 11 23:15:54 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD, size 20.69 MB, duration 3.69 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:15:54 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Image download 20.69 MB at 5.60 MB/s
Sep 11 23:15:54 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071434e-62c9-4902-bb4b-57aa1131c58e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:54 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD
Sep 11 23:15:54 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:54 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:54 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Temporary image bff82cbf-263a-48e8-8001-6d21dac3df6f is fetched for user d5a053e5603c4355b9ced35109dd6b7d. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db7125a-624c-454c-b92a-b770b811420e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:55 devstack sudo[102544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD
Sep 11 23:15:55 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:55 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2110746387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c22690-0d24-4f5c-a313-e9cf9900e68c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='415264fc13e1419d970222e60529bd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:15:50Z,use_quota=True,user_id='d5a053e5603c4355b9ced35109dd6b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd4260b8-d92c-4d37-b781-1166fddff246),volume_type_id=fd4260b8-d92c-4d37-b781-1166fddff246)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Creating volume 96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:15:55 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:55 devstack sudo[102549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1073741824
Sep 11 23:15:55 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:55 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1073741824" returned: 0 in 0.393s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:55 devstack sudo[102556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c
Sep 11 23:15:55 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:56 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Attempting download of bff82cbf-263a-48e8-8001-6d21dac3df6f ((None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}])) to volume 96c22690-0d24-4f5c-a313-e9cf9900e68c. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d2088a-1f12-4f8d-87af-1ebe2007fe60]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:56 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8
Sep 11 23:15:56 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:56 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:56 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8
Sep 11 23:15:56 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:56 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8" returned: 1 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bff82cbf-263a-48e8-8001-6d21dac3df6f_pfe_95p8' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2702e8-a26b-4d69-bbba-9f9b0899cd75]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:15:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:56 devstack sudo[102567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD
Sep 11 23:15:56 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:57 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:57 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] bff82cbf-263a-48e8-8001-6d21dac3df6f was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:15:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:57 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c
Sep 11 23:15:57 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:58 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c" returned: 0 in 1.667s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:58 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bff82cbf-263a-48e8-8001-6d21dac3df6f_c8wf7v9idevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:15:58 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Converted 112.00 MB image at 67.14 MB/s
Sep 11 23:15:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:15:58 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1G
Sep 11 23:15:58 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:15:59 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c 1G" returned: 0 in 0.312s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Downloaded image bff82cbf-263a-48e8-8001-6d21dac3df6f ((None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}])) to volume 96c22690-0d24-4f5c-a313-e9cf9900e68c successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Temporary image bff82cbf-263a-48e8-8001-6d21dac3df6f for user d5a053e5603c4355b9ced35109dd6b7d is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Marking volume 96c22690-0d24-4f5c-a313-e9cf9900e68c as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Copying metadata from image bff82cbf-263a-48e8-8001-6d21dac3df6f to 96c22690-0d24-4f5c-a313-e9cf9900e68c. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Creating volume glance metadata for volume 96c22690-0d24-4f5c-a313-e9cf9900e68c backed by image bff82cbf-263a-48e8-8001-6d21dac3df6f with: {'image_id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'image_name': 'tempest-scenario-img--1047659693', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a335820-c743-4683-87fb-8a34718c33cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c22690-0d24-4f5c-a313-e9cf9900e68c', 'volume_size': 1, 'image_id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bff82cbf-263a-48e8-8001-6d21dac3df6f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1047659693', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '415264fc13e1419d970222e60529bd73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bff82cbf-263a-48e8-8001-6d21dac3df6f', 'created_at': datetime.datetime(2026, 9, 11, 21, 15, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bff82cbf-263a-48e8-8001-6d21dac3df6f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63f7b00>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb29d575-856f-4efb-aef9-93be1692adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:15:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Volume volume-96c22690-0d24-4f5c-a313-e9cf9900e68c (96c22690-0d24-4f5c-a313-e9cf9900e68c): created successfully
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb29d575-856f-4efb-aef9-93be1692adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:15:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Flow 'volume_create_manager' (4c41bf04-8c4c-4de9-91b2-e2e774635998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:15:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-914d87cd-0a92-47ae-81c8-5426b980af52 tempest-TestInstancesWithCinderVolumes-849661769 None] Created volume successfully.
Sep 11 23:16:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-376bdb4a-5902-4407-a066-7aa0a003a300 req-8e4e3a27-ca0d-4900-9b29-1f9f5b1a427c tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-376bdb4a-5902-4407-a066-7aa0a003a300 req-8e4e3a27-ca0d-4900-9b29-1f9f5b1a427c tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-376bdb4a-5902-4407-a066-7aa0a003a300 req-8e4e3a27-ca0d-4900-9b29-1f9f5b1a427c tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-376bdb4a-5902-4407-a066-7aa0a003a300 req-8e4e3a27-ca0d-4900-9b29-1f9f5b1a427c tempest-TestInstancesWithCinderVolumes-849661769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-96c22690-0d24-4f5c-a313-e9cf9900e68c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e0942cd-6317-4125-9bff-aebd0ced38b1', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:16:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-376bdb4a-5902-4407-a066-7aa0a003a300 req-8e4e3a27-ca0d-4900-9b29-1f9f5b1a427c tempest-TestInstancesWithCinderVolumes-849661769 None] attachment_update completed successfully.
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Flow 'volume_create_manager' (13fd70c4-d74b-4b25-96e5-b955cc7b1fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11cb03d-7e8c-4bac-a16a-5d8967529023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d11cb03d-7e8c-4bac-a16a-5d8967529023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1867659824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6900a9b1-6e4c-4413-93c7-b75a61312e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d44f91ed1e14a67bd49d0624a97bcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:08Z,use_quota=True,user_id='b194be92edbc4db3b0a7aa8e3513cdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7085450a-a5f7-47d6-a9bc-031f7b96edc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7085450a-a5f7-47d6-a9bc-031f7b96edc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e661c5-b637-4784-a2ca-9f3c6e23f390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e661c5-b637-4784-a2ca-9f3c6e23f390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6900a9b1-6e4c-4413-93c7-b75a61312e53', 'volume_name': 'volume-6900a9b1-6e4c-4413-93c7-b75a61312e53', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b55e15-4884-416a-8539-7749cc3a31a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b55e15-4884-416a-8539-7749cc3a31a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a30c55-f6a0-40d3-9b46-9d606da9f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Volume 6900a9b1-6e4c-4413-93c7-b75a61312e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6900a9b1-6e4c-4413-93c7-b75a61312e53', 'volume_size': 1}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1867659824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6900a9b1-6e4c-4413-93c7-b75a61312e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d44f91ed1e14a67bd49d0624a97bcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:08Z,use_quota=True,user_id='b194be92edbc4db3b0a7aa8e3513cdd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Creating volume 6900a9b1-6e4c-4413-93c7-b75a61312e53 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:16:08 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:08 devstack sudo[103056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 1073741824
Sep 11 23:16:08 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:08 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 1073741824" returned: 0 in 0.511s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:08 devstack sudo[103062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53
Sep 11 23:16:08 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:09 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a30c55-f6a0-40d3-9b46-9d606da9f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6900a9b1-6e4c-4413-93c7-b75a61312e53', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e277ce78-a77f-4530-ab94-e23c630d03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Volume volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 (6900a9b1-6e4c-4413-93c7-b75a61312e53): created successfully
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e277ce78-a77f-4530-ab94-e23c630d03e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Flow 'volume_create_manager' (13fd70c4-d74b-4b25-96e5-b955cc7b1fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:16:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c8faa783-11a3-4a8f-a087-e0d689996de8 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Created volume successfully.
Sep 11 23:16:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-03799e2c-8776-40c8-a97d-cec93e9c159e req-2f516ca6-3d98-4a71-919d-1e5dd7b8f81d tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-03799e2c-8776-40c8-a97d-cec93e9c159e req-2f516ca6-3d98-4a71-919d-1e5dd7b8f81d tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-03799e2c-8776-40c8-a97d-cec93e9c159e req-2f516ca6-3d98-4a71-919d-1e5dd7b8f81d tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-03799e2c-8776-40c8-a97d-cec93e9c159e req-2f516ca6-3d98-4a71-919d-1e5dd7b8f81d tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-6900a9b1-6e4c-4413-93c7-b75a61312e53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a3906a1-e7ec-4375-b55a-f6519a25e654', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:16:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-03799e2c-8776-40c8-a97d-cec93e9c159e req-2f516ca6-3d98-4a71-919d-1e5dd7b8f81d tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] attachment_update completed successfully.
Sep 11 23:16:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-4353a9a9-ff7d-4d7b-a7f3-469e7b29b183 req-63e2e736-2b6b-4a6c-864b-97c7cd742321 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Terminate volume connection completed successfully.
Sep 11 23:16:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-4353a9a9-ff7d-4d7b-a7f3-469e7b29b183 req-63e2e736-2b6b-4a6c-864b-97c7cd742321 tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Deleting attachment 9a3906a1-e7ec-4375-b55a-f6519a25e654. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:16:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "cinder-6900a9b1-6e4c-4413-93c7-b75a61312e53-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "cinder-6900a9b1-6e4c-4413-93c7-b75a61312e53-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "cinder-quobyte-6900a9b1-6e4c-4413-93c7-b75a61312e53" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "cinder-quobyte-6900a9b1-6e4c-4413-93c7-b75a61312e53" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ece704e-2f46-4953-af9d-e92f149831ab]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:16 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53
Sep 11 23:16:16 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:16 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:16 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53
Sep 11 23:16:16 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:16 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6900a9b1-6e4c-4413-93c7-b75a61312e53" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "cinder-quobyte-6900a9b1-6e4c-4413-93c7-b75a61312e53" released by "delete_volume" :: held 0.651s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Created reservations ['ab264155-8c52-4401-9f0b-3ec5537c43b9', '491d5458-efb0-43e3-8449-06360d65dea2', '4be0a8c9-7fdd-4b4e-8f44-55ce8d2cf58e', '44dc906d-a08d-49ed-b3e3-008fa7f0b4eb'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:16 devstack sudo[103131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:16 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:17 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.263s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:17 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Deleted volume successfully.
Sep 11 23:16:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bfd7035-4518-46bf-aebd-f91608c9ac1a tempest-TestServerVolumeAttachScenarioOldVersion-586744911 None] Lock "cinder-6900a9b1-6e4c-4413-93c7-b75a61312e53-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:26 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=59,cinder:UPDATE=56,cinder:DELETE=4,cinder:INSERT=16 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:16:27 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=22,cinder:SELECT=35,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:16:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-e284642a-a8b8-4046-a578-79ad61d995a8 req-5a863126-c598-4091-92c2-c858eaff5ef9 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-e284642a-a8b8-4046-a578-79ad61d995a8 req-5a863126-c598-4091-92c2-c858eaff5ef9 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-e284642a-a8b8-4046-a578-79ad61d995a8 req-5a863126-c598-4091-92c2-c858eaff5ef9 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-e284642a-a8b8-4046-a578-79ad61d995a8 req-5a863126-c598-4091-92c2-c858eaff5ef9 tempest-TestInstancesWithCinderVolumes-849661769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-1ec06117-07ff-4ede-b808-37de1cd8d091', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cea185ed-17fd-4695-9198-be1b1dc58659', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:16:34 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-e284642a-a8b8-4046-a578-79ad61d995a8 req-5a863126-c598-4091-92c2-c858eaff5ef9 tempest-TestInstancesWithCinderVolumes-849661769 None] attachment_update completed successfully.
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Flow 'volume_create_manager' (b9be175f-a0a6-454b-98bd-326611a04990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456deda-ed45-406d-913a-142c3b8b5333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8456deda-ed45-406d-913a-142c3b8b5333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb66e49f-f7dc-4574-8f45-0dfe350a2439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d240f2a26cc14428a586cda4d403c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:35Z,use_quota=True,user_id='1311df9036964bcdb00342e94539a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6602577-9488-4d91-8d60-877f91874a5a),volume_type_id=c6602577-9488-4d91-8d60-877f91874a5a)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4884e09-312c-481b-9871-6223ecfdd84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4884e09-312c-481b-9871-6223ecfdd84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0fa8d-073c-4e61-b6b0-4a48de11ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d0fa8d-073c-4e61-b6b0-4a48de11ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bb66e49f-f7dc-4574-8f45-0dfe350a2439', 'volume_name': 'volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439', 'volume_size': 1, 'image_id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a72cff397fe2f26b782af8593ed494ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd240f2a26cc14428a586cda4d403c203', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5842f9152635859467998aeacced0ed6880abdeec3bd471fc95cda43e935fee152524824762375a6e03b8a579025793726bc2170e9be5fd0cf315d2a33e9ef8f', 'id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb65d3530>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678f687f-7938-48f0-8aad-c2ecd2379375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678f687f-7938-48f0-8aad-c2ecd2379375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d075bbc-4660-4058-91ca-f6a49c2e30cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Volume bb66e49f-f7dc-4574-8f45-0dfe350a2439: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439', 'volume_size': 1, 'image_id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a72cff397fe2f26b782af8593ed494ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd240f2a26cc14428a586cda4d403c203', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5842f9152635859467998aeacced0ed6880abdeec3bd471fc95cda43e935fee152524824762375a6e03b8a579025793726bc2170e9be5fd0cf315d2a33e9ef8f', 'id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb65d3530>}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Trying to clone bb66e49f-f7dc-4574-8f45-0dfe350a2439 from image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:16:35 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e074fd1-f14a-4e56-b5f0-c51d295bcd2f]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:35 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:35 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:36 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:36 devstack sudo[103245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:36 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:36 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Temporary image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 is fetched for user 1311df9036964bcdb00342e94539a616. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-31c33ecc-84fd-4e2f-9e3f-c30dd7979d6b req-1745b31d-62c4-4784-9c37-311476b3112a tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-31c33ecc-84fd-4e2f-9e3f-c30dd7979d6b req-1745b31d-62c4-4784-9c37-311476b3112a tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[516cd4d6-a99c-4179-921f-41b92ccca0e1]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-31c33ecc-84fd-4e2f-9e3f-c30dd7979d6b req-1745b31d-62c4-4784-9c37-311476b3112a tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:36 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-31c33ecc-84fd-4e2f-9e3f-c30dd7979d6b req-1745b31d-62c4-4784-9c37-311476b3112a tempest-TestInstancesWithCinderVolumes-849661769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16ef3f83-c595-4151-89a7-a3571ab906d8', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:16:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-31c33ecc-84fd-4e2f-9e3f-c30dd7979d6b req-1745b31d-62c4-4784-9c37-311476b3112a tempest-TestInstancesWithCinderVolumes-849661769 None] attachment_update completed successfully.
Sep 11 23:16:36 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:36 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:37 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:37 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:37 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:37 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb66e49f-f7dc-4574-8f45-0dfe350a2439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d240f2a26cc14428a586cda4d403c203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:16:35Z,use_quota=True,user_id='1311df9036964bcdb00342e94539a616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6602577-9488-4d91-8d60-877f91874a5a),volume_type_id=c6602577-9488-4d91-8d60-877f91874a5a)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Creating volume bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:16:37 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:37 devstack sudo[103270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1073741824
Sep 11 23:16:37 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:37 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1073741824" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:37 devstack sudo[103284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439
Sep 11 23:16:37 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:38 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Attempting download of 08dbf2e3-4eb8-476b-a846-a0d94878cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}])) to volume bb66e49f-f7dc-4574-8f45-0dfe350a2439. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e43e69-529f-48b9-964a-614c708ccc05]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:38 devstack sudo[103287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x
Sep 11 23:16:38 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:38 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x" returned: 0 in 0.347s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:38 devstack sudo[103291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x
Sep 11 23:16:38 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:38 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x" returned: 1 in 0.349s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08dbf2e3-4eb8-476b-a846-a0d94878cb53_n1m7sp0x' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e72336-fc2c-49fd-8e24-6dea85acd6f3]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:39 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:39 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:39 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:39 devstack sudo[103300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD
Sep 11 23:16:39 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:39 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] 08dbf2e3-4eb8-476b-a846-a0d94878cb53 was raw, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:16:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:39 devstack sudo[103307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439
Sep 11 23:16:39 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:40 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439" returned: 0 in 0.460s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08dbf2e3-4eb8-476b-a846-a0d94878cb53_46m79bcvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:16:40 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:40 devstack sudo[103322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1G
Sep 11 23:16:40 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:40 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 1G" returned: 0 in 0.328s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Downloaded image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}])) to volume bb66e49f-f7dc-4574-8f45-0dfe350a2439 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Temporary image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 for user 1311df9036964bcdb00342e94539a616 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Marking volume bb66e49f-f7dc-4574-8f45-0dfe350a2439 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Copying metadata from image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 to bb66e49f-f7dc-4574-8f45-0dfe350a2439. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Creating volume glance metadata for volume bb66e49f-f7dc-4574-8f45-0dfe350a2439 backed by image 08dbf2e3-4eb8-476b-a846-a0d94878cb53 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a72cff397fe2f26b782af8593ed494ef', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d075bbc-4660-4058-91ca-f6a49c2e30cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439', 'volume_size': 1, 'image_id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a72cff397fe2f26b782af8593ed494ef', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd240f2a26cc14428a586cda4d403c203', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5842f9152635859467998aeacced0ed6880abdeec3bd471fc95cda43e935fee152524824762375a6e03b8a579025793726bc2170e9be5fd0cf315d2a33e9ef8f', 'id': '08dbf2e3-4eb8-476b-a846-a0d94878cb53', 'created_at': datetime.datetime(2026, 9, 11, 21, 16, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 16, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08dbf2e3-4eb8-476b-a846-a0d94878cb53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb65d3530>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb228bd-cef2-4a17-91a6-24191be92117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:16:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Volume volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 (bb66e49f-f7dc-4574-8f45-0dfe350a2439): created successfully
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb228bd-cef2-4a17-91a6-24191be92117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Flow 'volume_create_manager' (b9be175f-a0a6-454b-98bd-326611a04990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:16:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5528c1b3-50c1-4a87-b9da-8b1654fc6537 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Created volume successfully.
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Acquiring lock "cinder-bb66e49f-f7dc-4574-8f45-0dfe350a2439-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "cinder-bb66e49f-f7dc-4574-8f45-0dfe350a2439-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Acquiring lock "cinder-quobyte-bb66e49f-f7dc-4574-8f45-0dfe350a2439" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "cinder-quobyte-bb66e49f-f7dc-4574-8f45-0dfe350a2439" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab29348f-21ee-4c3e-9115-377ba8caa277]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:41 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439
Sep 11 23:16:41 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:41 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:41 devstack sudo[103344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439
Sep 11 23:16:41 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-cc4b98d8-51f5-4de1-9d05-3dd8eca04c35 req-d0f508d9-ba22-4a23-869b-abef38a3d0a3 tempest-TestInstancesWithCinderVolumes-849661769 None] Terminate volume connection completed successfully.
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-cc4b98d8-51f5-4de1-9d05-3dd8eca04c35 req-d0f508d9-ba22-4a23-869b-abef38a3d0a3 tempest-TestInstancesWithCinderVolumes-849661769 None] Deleting attachment cea185ed-17fd-4695-9198-be1b1dc58659. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:16:41 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bb66e49f-f7dc-4574-8f45-0dfe350a2439" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "cinder-quobyte-bb66e49f-f7dc-4574-8f45-0dfe350a2439" released by "delete_volume" :: held 0.716s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:41 devstack cinder-volume[88022]: WARNING cinder.quota [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:41 devstack cinder-volume[88022]: WARNING cinder.quota [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Created reservations ['1d73a217-eeac-4e08-ba9c-0c1841bd2cbd', '2a8c34c4-8862-401f-8647-6d71789e761d', '999f71a1-f7d2-45e3-80c7-866d88bb4d12', 'a8e1baf9-c828-481c-90e6-f7f7236dde00'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:41 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:41 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:41 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.279s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:41 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Deleted volume successfully.
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-07177df1-39d4-4957-ba59-d9207b3a2c79 tempest-VolumeAndVolumeTypeFromImageTest-1802386750 None] Lock "cinder-bb66e49f-f7dc-4574-8f45-0dfe350a2439-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-1ec06117-07ff-4ede-b808-37de1cd8d091-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-1ec06117-07ff-4ede-b808-37de1cd8d091-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-quobyte-1ec06117-07ff-4ede-b808-37de1cd8d091" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-1ec06117-07ff-4ede-b808-37de1cd8d091" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda75227-832c-4241-b79f-309b6541d87f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:42 devstack sudo[103358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091
Sep 11 23:16:42 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:42 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091" returned: 0 in 0.419s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:42 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091
Sep 11 23:16:42 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:43 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1ec06117-07ff-4ede-b808-37de1cd8d091" returned: 0 in 0.297s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-1ec06117-07ff-4ede-b808-37de1cd8d091" released by "delete_volume" :: held 0.764s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:43 devstack cinder-volume[88022]: WARNING cinder.quota [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895021358-1450914303 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895021358-1450914303, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:43 devstack cinder-volume[88022]: WARNING cinder.quota [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895021358-1450914303 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-895021358-1450914303, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Created reservations ['dc9820c9-19a5-4a6c-8487-eed3d295206f', '8a1ce775-859b-4564-afed-e615f29784e3', 'd3092a13-97e0-4ce0-8738-adc53b343018', 'd42cf23c-b552-42f6-af12-dd509f314ed5'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:43 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:43 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:43 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Deleted volume successfully.
Sep 11 23:16:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-96324f86-ea5d-4871-bad9-6173b0c75329 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-1ec06117-07ff-4ede-b808-37de1cd8d091-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:46 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:46 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:46 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-3e904baf-0efa-418a-ab00-81cde04e05e0 req-7ddc7831-184b-4c4a-ac04-6ca21ac1be98 tempest-TestInstancesWithCinderVolumes-849661769 None] Terminate volume connection completed successfully.
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-3e904baf-0efa-418a-ab00-81cde04e05e0 req-7ddc7831-184b-4c4a-ac04-6ca21ac1be98 tempest-TestInstancesWithCinderVolumes-849661769 None] Deleting attachment 16ef3f83-c595-4151-89a7-a3571ab906d8. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:16:46 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-6013a35f-8b1a-4ef9-93f2-bab020a8cd29-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-6013a35f-8b1a-4ef9-93f2-bab020a8cd29-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-quobyte-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2cbff-d52c-468e-9378-11480d99271c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:47 devstack sudo[103399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29
Sep 11 23:16:47 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:47 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:47 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29
Sep 11 23:16:47 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:47 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-6013a35f-8b1a-4ef9-93f2-bab020a8cd29" released by "delete_volume" :: held 0.737s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:47 devstack cinder-volume[88022]: WARNING cinder.quota [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-715052791-1265617162 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-715052791-1265617162, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:47 devstack cinder-volume[88022]: WARNING cinder.quota [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-715052791-1265617162 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-715052791-1265617162, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Created reservations ['ad7f088f-0927-400b-b49b-754f722f79d7', '20c269e8-2989-461a-ae76-f7681eb61fad', '7d3a6e0c-6f0c-4ec5-a1cd-a3da76175d2c', '49d6ba4a-fe8d-43e0-87d7-69021eb52e99'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:47 devstack sudo[103407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:47 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:48 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.304s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:48 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Deleted volume successfully.
Sep 11 23:16:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7054f3d2-7477-4625-a9d4-8c064f1ebef4 tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-6013a35f-8b1a-4ef9-93f2-bab020a8cd29-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-73c485f7-8e33-45a3-815d-9cb0796502e0 req-d9d8aa18-dce1-405e-983c-eef00427211f tempest-TestInstancesWithCinderVolumes-849661769 None] Terminate volume connection completed successfully.
Sep 11 23:16:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-73c485f7-8e33-45a3-815d-9cb0796502e0 req-d9d8aa18-dce1-405e-983c-eef00427211f tempest-TestInstancesWithCinderVolumes-849661769 None] Deleting attachment 6e0942cd-6317-4125-9bff-aebd0ced38b1. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-96c22690-0d24-4f5c-a313-e9cf9900e68c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-96c22690-0d24-4f5c-a313-e9cf9900e68c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "cinder-quobyte-96c22690-0d24-4f5c-a313-e9cf9900e68c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-96c22690-0d24-4f5c-a313-e9cf9900e68c" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1143d24-69e8-4875-9965-6568dc10ef96]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:52 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c
Sep 11 23:16:52 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:52 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c" returned: 0 in 0.359s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:52 devstack sudo[103441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c
Sep 11 23:16:52 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:52 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-96c22690-0d24-4f5c-a313-e9cf9900e68c" returned: 0 in 0.241s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-quobyte-96c22690-0d24-4f5c-a313-e9cf9900e68c" released by "delete_volume" :: held 0.636s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:16:52 devstack cinder-volume[88022]: WARNING cinder.quota [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1829796976-747322050 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1829796976-747322050, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:52 devstack cinder-volume[88022]: WARNING cinder.quota [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1829796976-747322050 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1829796976-747322050, it is now deprecated. Please use the default quota class for default quota.
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Created reservations ['949b3765-a2fa-4619-9d1d-082f9409d50d', '8f50dd11-81e3-411c-8f2e-d5b4c495f5b5', '26274140-8d90-4875-b280-933e35a87ebe', '3fef9aea-6cc6-4cef-9a2f-6a662ea76b76'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:16:53 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:16:53 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:16:53 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.228s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:16:53 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Deleted volume successfully.
Sep 11 23:16:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c100d393-17c7-4a8e-922b-bb090a1cb2ac tempest-TestInstancesWithCinderVolumes-849661769 None] Lock "cinder-96c22690-0d24-4f5c-a313-e9cf9900e68c-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:17:03 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=46,cinder:UPDATE=40,cinder:INSERT=15,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:17:03 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=42,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Flow 'volume_create_manager' (535845d4-d9ba-4e43-ad99-f1e1f2ccc042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ea3d50-4cb0-4f67-8c8c-4b98c5a17115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ea3d50-4cb0-4f67-8c8c-4b98c5a17115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-213263133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c98a8-e33f-4760-9eba-08fe95eb18ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132efc78e5354180beaebfc964c7438f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:26Z,use_quota=True,user_id='aeacfcdabe4c49a8bca94f486de31669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f6e7d-8900-4ec3-95d2-03f91f544d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (351f6e7d-8900-4ec3-95d2-03f91f544d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf6e979-c997-4390-b9f3-275dc0bfcacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf6e979-c997-4390-b9f3-275dc0bfcacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7c98a8-e33f-4760-9eba-08fe95eb18ad', 'volume_name': 'volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b060ee-7cc0-427d-9443-625c9e1ba6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b060ee-7cc0-427d-9443-625c9e1ba6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2865229-ea7e-44f3-a668-407854d4379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume 9f7c98a8-e33f-4760-9eba-08fe95eb18ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad', 'volume_size': 1}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-213263133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c98a8-e33f-4760-9eba-08fe95eb18ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132efc78e5354180beaebfc964c7438f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:26Z,use_quota=True,user_id='aeacfcdabe4c49a8bca94f486de31669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Creating volume 9f7c98a8-e33f-4760-9eba-08fe95eb18ad {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:17:26 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:17:26 devstack sudo[103504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad 1073741824
Sep 11 23:17:26 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Flow 'volume_create_manager' (561a0d31-3aa3-4494-bcd7-4c121aa8a7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128c5d8-1863-4564-985a-3b5a2f25966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c128c5d8-1863-4564-985a-3b5a2f25966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1516633621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c061044-cb4e-4035-bffa-2c31b9cc1ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132efc78e5354180beaebfc964c7438f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:27Z,use_quota=True,user_id='aeacfcdabe4c49a8bca94f486de31669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab054794-8263-40fd-a671-bad7c36416db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab054794-8263-40fd-a671-bad7c36416db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebece80-b297-48b9-904d-f06c3796ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ebece80-b297-48b9-904d-f06c3796ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c061044-cb4e-4035-bffa-2c31b9cc1ea9', 'volume_name': 'volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84d9b24-300a-4740-91f1-9d49d361a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84d9b24-300a-4740-91f1-9d49d361a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7cec31-5fd5-45f3-9ceb-f34d3784850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:26 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume 8c061044-cb4e-4035-bffa-2c31b9cc1ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9', 'volume_size': 1}
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:26 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root
Sep 11 23:17:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad 1073741824" returned: 0 in 0.469s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:17:27 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad
Sep 11 23:17:27 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:17:27 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1516633621',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c061044-cb4e-4035-bffa-2c31b9cc1ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='132efc78e5354180beaebfc964c7438f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:17:27Z,use_quota=True,user_id='aeacfcdabe4c49a8bca94f486de31669',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Creating volume 8c061044-cb4e-4035-bffa-2c31b9cc1ea9 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:17:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2865229-ea7e-44f3-a668-407854d4379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:27 devstack sudo[103513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 1073741824
Sep 11 23:17:27 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f4f7dd-6f82-4edb-b47f-78716e931ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad (9f7c98a8-e33f-4760-9eba-08fe95eb18ad): created successfully
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f4f7dd-6f82-4edb-b47f-78716e931ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Flow 'volume_create_manager' (535845d4-d9ba-4e43-ad99-f1e1f2ccc042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:17:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1bf0833c-916b-4c51-886b-53ad94edfde9 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Created volume successfully.
Sep 11 23:17:27 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 1073741824" returned: 0 in 0.466s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:17:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:17:27 devstack sudo[103518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9
Sep 11 23:17:27 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:17:28 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba7cec31-5fd5-45f3-9ceb-f34d3784850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eeaef0-6e87-4e3f-9484-7e7438f489b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:17:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Volume volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 (8c061044-cb4e-4035-bffa-2c31b9cc1ea9): created successfully
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89eeaef0-6e87-4e3f-9484-7e7438f489b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:17:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Flow 'volume_create_manager' (561a0d31-3aa3-4494-bcd7-4c121aa8a7cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:17:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-51bd3a05-e685-4e1f-a8cd-a693a90ebc84 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Created volume successfully.
Sep 11 23:17:38 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:17:38 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:17:46 devstack sudo[103615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:17:46 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:17:46 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.248s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:17:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:17:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4df59e0d-9a65-405a-91c5-03dfd4c9136f req-f3e5d049-efa9-44c0-9993-a2ce972d7c05 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:17:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4df59e0d-9a65-405a-91c5-03dfd4c9136f req-f3e5d049-efa9-44c0-9993-a2ce972d7c05 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:17:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-4df59e0d-9a65-405a-91c5-03dfd4c9136f req-f3e5d049-efa9-44c0-9993-a2ce972d7c05 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:17:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-4df59e0d-9a65-405a-91c5-03dfd4c9136f req-f3e5d049-efa9-44c0-9993-a2ce972d7c05 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97edc838-f43d-4201-b26e-3cf99d55e105', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:17:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-4df59e0d-9a65-405a-91c5-03dfd4c9136f req-f3e5d049-efa9-44c0-9993-a2ce972d7c05 tempest-TestServerVolumeAttachmentScenario-1710059355 None] attachment_update completed successfully.
Sep 11 23:18:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ffbc47b1-80e0-471c-bb47-ff77efebbfd4 req-afee89db-a6f2-4e01-891b-cabaaa449e76 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ffbc47b1-80e0-471c-bb47-ff77efebbfd4 req-afee89db-a6f2-4e01-891b-cabaaa449e76 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-ffbc47b1-80e0-471c-bb47-ff77efebbfd4 req-afee89db-a6f2-4e01-891b-cabaaa449e76 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-ffbc47b1-80e0-471c-bb47-ff77efebbfd4 req-afee89db-a6f2-4e01-891b-cabaaa449e76 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b1a0781-24bf-4762-90ac-d6faef708ec5', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:18:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-ffbc47b1-80e0-471c-bb47-ff77efebbfd4 req-afee89db-a6f2-4e01-891b-cabaaa449e76 tempest-TestServerVolumeAttachmentScenario-1710059355 None] attachment_update completed successfully.
Sep 11 23:18:02 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-7ba87e18-6f44-4af4-8ca3-0f564bc5cf22 req-d3b31912-7947-4efe-873f-0cb3fd0dc45d tempest-TestServerVolumeAttachmentScenario-1710059355 None] Terminate volume connection completed successfully.
Sep 11 23:18:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-7ba87e18-6f44-4af4-8ca3-0f564bc5cf22 req-d3b31912-7947-4efe-873f-0cb3fd0dc45d tempest-TestServerVolumeAttachmentScenario-1710059355 None] Deleting attachment 5b1a0781-24bf-4762-90ac-d6faef708ec5. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:18:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-c7d97787-f996-41c0-92e0-b0777b486e5a req-c1af27b3-9089-43d9-aa68-00475db45534 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Terminate volume connection completed successfully.
Sep 11 23:18:03 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-c7d97787-f996-41c0-92e0-b0777b486e5a req-c1af27b3-9089-43d9-aa68-00475db45534 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Deleting attachment 97edc838-f43d-4201-b26e-3cf99d55e105. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "cinder-8c061044-cb4e-4035-bffa-2c31b9cc1ea9-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-8c061044-cb4e-4035-bffa-2c31b9cc1ea9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "cinder-quobyte-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-quobyte-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0857f6b-2928-45b0-8eeb-c1469286322b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:08 devstack sudo[104102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9
Sep 11 23:18:08 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:08 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:08 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9
Sep 11 23:18:08 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:08 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" returned: 0 in 0.241s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-quobyte-8c061044-cb4e-4035-bffa-2c31b9cc1ea9" released by "delete_volume" :: held 0.633s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Created reservations ['243312bb-1ad5-4055-ae3b-ee897130725f', 'c86504a1-dd34-4356-93c5-7a2805b5c02e', '601cf5a7-e7bd-4b0d-b08d-fd7d4e17d6b5', '301772e8-ea2e-42ba-a919-9039518f331d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:08 devstack sudo[104110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:18:08 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:09 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:18:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Deleted volume successfully.
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-4de82021-f70d-4b09-90a7-a254add60934 tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-8c061044-cb4e-4035-bffa-2c31b9cc1ea9-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "cinder-9f7c98a8-e33f-4760-9eba-08fe95eb18ad-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-9f7c98a8-e33f-4760-9eba-08fe95eb18ad-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "cinder-quobyte-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-quobyte-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8884e60c-6323-4bbf-a002-174232eae8aa]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:09 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad
Sep 11 23:18:09 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:09 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:09 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad
Sep 11 23:18:09 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:09 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-quobyte-9f7c98a8-e33f-4760-9eba-08fe95eb18ad" released by "delete_volume" :: held 0.636s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Created reservations ['9e188d1a-86f8-4348-93a6-112d6f31d0b4', 'eb2717ff-cd35-4c4a-82e7-bbd399506296', 'ff2c1fb1-04f2-417b-ad46-3beebc448ed3', '5d7aab57-4327-4b7e-8516-325b8f84c8ec'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:10 devstack sudo[104121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:18:10 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:10 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:10 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:18:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Deleted volume successfully.
Sep 11 23:18:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9228ccb4-1301-433e-8aa8-05e956efa85b tempest-TestServerVolumeAttachmentScenario-1710059355 None] Lock "cinder-9f7c98a8-e33f-4760-9eba-08fe95eb18ad-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:18:19 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=20,cinder:SELECT=26,cinder:INSERT=3 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:18:20 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=25,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Flow 'volume_create_manager' (408c7a55-af4e-4b56-a83f-c11ba05257b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac7f283-27fc-4f8d-b4a1-8091f801ef70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac7f283-27fc-4f8d-b4a1-8091f801ef70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1382538113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecd9967-5e1d-4204-b68e-3aec20f2350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e8975ce8d4447d96b153e2a1a96f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:45Z,use_quota=True,user_id='fb059613f7b043e483daf737bfdf09ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b4647-b91a-49a0-86e0-22fcc96bbedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5b4647-b91a-49a0-86e0-22fcc96bbedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc2d4d8-2b7d-4c35-8c53-4c63c81d6f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc2d4d8-2b7d-4c35-8c53-4c63c81d6f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cecd9967-5e1d-4204-b68e-3aec20f2350d', 'volume_name': 'volume-cecd9967-5e1d-4204-b68e-3aec20f2350d', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e55e0>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f67a4e-6e91-4c09-965e-6a5bfe4800fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f67a4e-6e91-4c09-965e-6a5bfe4800fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7a74c1-7917-4420-a915-27a531cc094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:45 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Volume cecd9967-5e1d-4204-b68e-3aec20f2350d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cecd9967-5e1d-4204-b68e-3aec20f2350d', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e55e0>}
Sep 11 23:18:45 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Trying to clone cecd9967-5e1d-4204-b68e-3aec20f2350d from image 414d8567-5d24-440f-be04-3f648fa33a01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:46 devstack sudo[104179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:18:46 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:18:46 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Image download 20.69 MB at 20.69 MB/s
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[248ab50b-26d5-45fd-aa9a-6ccfb21027dc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:46 devstack sudo[104182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD
Sep 11 23:18:46 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:46 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.277s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:18:46 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 is fetched for user fb059613f7b043e483daf737bfdf09ad. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602167a-54f0-4451-8ec9-c636e31cbd2a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:46 devstack sudo[104188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD
Sep 11 23:18:46 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:46 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD" returned: 0 in 0.315s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1382538113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecd9967-5e1d-4204-b68e-3aec20f2350d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43e8975ce8d4447d96b153e2a1a96f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:18:45Z,use_quota=True,user_id='fb059613f7b043e483daf737bfdf09ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Creating volume cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:18:46 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:18:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:46 devstack sudo[104193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1073741824
Sep 11 23:18:46 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:47 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1073741824" returned: 0 in 0.396s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:47 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d
Sep 11 23:18:47 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:47 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d" returned: 0 in 0.244s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Attempting download of 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume cecd9967-5e1d-4204-b68e-3aec20f2350d. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a462bd-e65b-468a-b40c-2c97c2d2a964]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:47 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6
Sep 11 23:18:47 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:47 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:48 devstack sudo[104206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6
Sep 11 23:18:48 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:48 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6" returned: 1 in 0.328s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_414d8567-5d24-440f-be04-3f648fa33a01_hgbawdm6' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fa64ce-0fc7-4d35-a822-c8342f0b2fe0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:48 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD
Sep 11 23:18:48 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:48 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD" returned: 0 in 0.314s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] 414d8567-5d24-440f-be04-3f648fa33a01 was qcow2, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:18:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:48 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d
Sep 11 23:18:48 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:50 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d" returned: 0 in 1.564s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_414d8567-5d24-440f-be04-3f648fa33a01_0n2wq8p4devstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:18:50 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Converted 112.00 MB image at 71.55 MB/s
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:18:50 devstack sudo[104226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1G
Sep 11 23:18:50 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:18:50 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d 1G" returned: 0 in 0.299s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Downloaded image 414d8567-5d24-440f-be04-3f648fa33a01 ((None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}])) to volume cecd9967-5e1d-4204-b68e-3aec20f2350d successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Temporary image 414d8567-5d24-440f-be04-3f648fa33a01 for user fb059613f7b043e483daf737bfdf09ad is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Marking volume cecd9967-5e1d-4204-b68e-3aec20f2350d as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Copying metadata from image 414d8567-5d24-440f-be04-3f648fa33a01 to cecd9967-5e1d-4204-b68e-3aec20f2350d. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Creating volume glance metadata for volume cecd9967-5e1d-4204-b68e-3aec20f2350d backed by image 414d8567-5d24-440f-be04-3f648fa33a01 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7a74c1-7917-4420-a915-27a531cc094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cecd9967-5e1d-4204-b68e-3aec20f2350d', 'volume_size': 1, 'image_id': '414d8567-5d24-440f-be04-3f648fa33a01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/414d8567-5d24-440f-be04-3f648fa33a01', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0c835bad567f4aa6ac39bf6944bb090b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '414d8567-5d24-440f-be04-3f648fa33a01', 'created_at': datetime.datetime(2026, 9, 11, 20, 55, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 20, 55, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/414d8567-5d24-440f-be04-3f648fa33a01/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e55e0>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d0afc-75f3-4033-a8a9-d2c0664e5b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:18:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Volume volume-cecd9967-5e1d-4204-b68e-3aec20f2350d (cecd9967-5e1d-4204-b68e-3aec20f2350d): created successfully
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d0afc-75f3-4033-a8a9-d2c0664e5b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:18:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Flow 'volume_create_manager' (408c7a55-af4e-4b56-a83f-c11ba05257b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:18:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8db54f36-772d-4551-9578-d695ccf392b3 tempest-TestShelveInstance-1533238118 None] Created volume successfully.
Sep 11 23:18:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-6af6e325-b1ef-47c0-bf64-bbebc16c50b3 req-3d9afed6-8ef1-4cc4-901f-a9a303a61878 tempest-TestShelveInstance-1533238118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:18:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-6af6e325-b1ef-47c0-bf64-bbebc16c50b3 req-3d9afed6-8ef1-4cc4-901f-a9a303a61878 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:18:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-6af6e325-b1ef-47c0-bf64-bbebc16c50b3 req-3d9afed6-8ef1-4cc4-901f-a9a303a61878 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:18:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-6af6e325-b1ef-47c0-bf64-bbebc16c50b3 req-3d9afed6-8ef1-4cc4-901f-a9a303a61878 tempest-TestShelveInstance-1533238118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-cecd9967-5e1d-4204-b68e-3aec20f2350d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4cba0c5d-bfbd-450e-8cf8-fe7f7355cdf2', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:18:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-6af6e325-b1ef-47c0-bf64-bbebc16c50b3 req-3d9afed6-8ef1-4cc4-901f-a9a303a61878 tempest-TestShelveInstance-1533238118 None] attachment_update completed successfully.
Sep 11 23:19:04 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:19:04 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:19:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-12d1d5f1-000b-4cc7-80ee-20a279834205 req-21b0c310-d2d4-4af1-a9f2-e9ed3d93585c tempest-TestShelveInstance-1533238118 None] Terminate volume connection completed successfully.
Sep 11 23:19:26 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-12d1d5f1-000b-4cc7-80ee-20a279834205 req-21b0c310-d2d4-4af1-a9f2-e9ed3d93585c tempest-TestShelveInstance-1533238118 None] Deleting attachment 4cba0c5d-bfbd-450e-8cf8-fe7f7355cdf2. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:19:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-32f4641e-0138-4d28-b2cf-17d5ef3f6ac9 req-7ac37994-1634-42cb-a802-027ccf4ac157 tempest-TestShelveInstance-1533238118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:19:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-32f4641e-0138-4d28-b2cf-17d5ef3f6ac9 req-7ac37994-1634-42cb-a802-027ccf4ac157 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:19:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-32f4641e-0138-4d28-b2cf-17d5ef3f6ac9 req-7ac37994-1634-42cb-a802-027ccf4ac157 tempest-TestShelveInstance-1533238118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:19:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-32f4641e-0138-4d28-b2cf-17d5ef3f6ac9 req-7ac37994-1634-42cb-a802-027ccf4ac157 tempest-TestShelveInstance-1533238118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970', 'name': 'volume-cecd9967-5e1d-4204-b68e-3aec20f2350d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '400ab282-cff7-401f-a979-a0cbb37ffab1', 'enforce_multipath': True} {{(pid=88022) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 11 23:19:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-32f4641e-0138-4d28-b2cf-17d5ef3f6ac9 req-7ac37994-1634-42cb-a802-027ccf4ac157 tempest-TestShelveInstance-1533238118 None] attachment_update completed successfully.
Sep 11 23:19:38 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:19:38 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=9 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:19:46 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:19:46 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:19:46 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.235s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:19:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:19:53 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-8a652612-c21c-4cfb-a55f-28b457efd986 tempest-TestShelveInstance-1533238118 None] Terminate volume connection completed successfully.
Sep 11 23:19:53 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-8a652612-c21c-4cfb-a55f-28b457efd986 tempest-TestShelveInstance-1533238118 None] Deleting attachment 400ab282-cff7-401f-a979-a0cbb37ffab1. {{(pid=88022) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Acquiring lock "cinder-cecd9967-5e1d-4204-b68e-3aec20f2350d-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "cinder-cecd9967-5e1d-4204-b68e-3aec20f2350d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Acquiring lock "cinder-quobyte-cecd9967-5e1d-4204-b68e-3aec20f2350d" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "cinder-quobyte-cecd9967-5e1d-4204-b68e-3aec20f2350d" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6fa0dd-23bb-46d8-b5a7-ea7fe2b268e5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:19:54 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d
Sep 11 23:19:54 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:19:54 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d" returned: 0 in 0.385s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:19:54 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d
Sep 11 23:19:54 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:19:54 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-cecd9967-5e1d-4204-b68e-3aec20f2350d" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "cinder-quobyte-cecd9967-5e1d-4204-b68e-3aec20f2350d" released by "delete_volume" :: held 0.657s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.quota [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Created reservations ['df755741-3123-4cae-b83d-6d68ea995876', '824f7fbd-be35-42d9-8760-b3d75768517d', 'aca40722-6de5-47e5-9111-fc5f1ad7b68d', '722e2922-e3a6-4c15-9108-7874801c1aa4'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:19:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:19:54 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:19:54 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:19:55 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Sep 11 23:19:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:19:55 devstack cinder-volume[88022]: DEBUG cinder.manager [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:19:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Deleted volume successfully.
Sep 11 23:19:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [req-27b7f2ac-0394-436f-98af-6a12a0d817cd req-dd2e7d21-3b95-4a88-bef2-8c05fee4a7d2 tempest-TestShelveInstance-1533238118 None] Lock "cinder-cecd9967-5e1d-4204-b68e-3aec20f2350d-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:04 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:20:05 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (06238461-b208-4861-a56a-1c0c6bd376bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d841f50a-9669-473c-a3f5-0d6f2b3b68fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d841f50a-9669-473c-a3f5-0d6f2b3b68fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86822717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3457a2-1052-43ff-a188-e810893427e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:07Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aab315f-6780-454b-a2af-47e8b7a9105e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aab315f-6780-454b-a2af-47e8b7a9105e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283612f5-29d9-4623-b08e-d8abab606fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (283612f5-29d9-4623-b08e-d8abab606fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3457a2-1052-43ff-a188-e810893427e4', 'volume_name': 'volume-6b3457a2-1052-43ff-a188-e810893427e4', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1000db8-b3a8-42f7-861a-a2babd4394a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1000db8-b3a8-42f7-861a-a2babd4394a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bea7b5-6149-495f-9fb4-c21260cc83c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume 6b3457a2-1052-43ff-a188-e810893427e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3457a2-1052-43ff-a188-e810893427e4', 'volume_size': 1}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86822717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3457a2-1052-43ff-a188-e810893427e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:07Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume 6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:07 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 1073741824
Sep 11 23:20:07 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:07 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 1073741824" returned: 0 in 0.410s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:07 devstack sudo[105379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4
Sep 11 23:20:07 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:07 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4" returned: 0 in 0.234s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bea7b5-6149-495f-9fb4-c21260cc83c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3457a2-1052-43ff-a188-e810893427e4', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7e8183-868c-4893-b21f-eb6d247ffe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-6b3457a2-1052-43ff-a188-e810893427e4 (6b3457a2-1052-43ff-a188-e810893427e4): created successfully
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7e8183-868c-4893-b21f-eb6d247ffe71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (06238461-b208-4861-a56a-1c0c6bd376bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3a5bf46b-2d56-4e42-b993-b0a5084b299d tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating offline snapshot a16545ab-010b-45dc-84b4-c32f617885cc of volume 6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36cc99a-b0f0-4602-80b4-b58fc509ac24]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:08 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4
Sep 11 23:20:08 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:08 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4" returned: 0 in 0.374s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:08 devstack sudo[105388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc 1G
Sep 11 23:20:08 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:09 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc 1G" returned: 0 in 0.436s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3457a2-1052-43ff-a188-e810893427e4 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:09 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3457a2-1052-43ff-a188-e810893427e4 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc
Sep 11 23:20:09 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:09 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b3457a2-1052-43ff-a188-e810893427e4 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:09 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc is being set with open permissions: ugo+rw
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:09 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc
Sep 11 23:20:09 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:09 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:09 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info
Sep 11 23:20:09 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:09 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:09 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info is being set with open permissions: ugo+rw
Sep 11 23:20:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:09 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info
Sep 11 23:20:09 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:10 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.info" returned: 0 in 0.235s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1b99c52f-4832-490f-b551-79b54f0f91bd tempest-CreateVolumesFromSnapshotTest-872610189 None] Create snapshot completed successfully
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (23427696-d7a1-4165-8a44-5d39678582ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7702999-d706-4ed3-9853-b18baf848e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7702999-d706-4ed3-9853-b18baf848e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713100596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9c0311-48b7-4956-823f-d88c5620ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a89811a-97c4-4839-a87d-87f80d8ad0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a89811a-97c4-4839-a87d-87f80d8ad0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5e5c48-671b-4649-8d34-bb714958b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5e5c48-671b-4649-8d34-bb714958b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9c0311-48b7-4956-823f-d88c5620ec8c', 'volume_name': 'volume-0d9c0311-48b7-4956-823f-d88c5620ec8c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3e8748-a5fc-4eba-8c1e-c6171b3d4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e3e8748-a5fc-4eba-8c1e-c6171b3d4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdb44be-da98-4ceb-a65d-1fb0fb0f8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume 0d9c0311-48b7-4956-823f-d88c5620ec8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9c0311-48b7-4956-823f-d88c5620ec8c', 'volume_size': 1}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-713100596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9c0311-48b7-4956-823f-d88c5620ec8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume 0d9c0311-48b7-4956-823f-d88c5620ec8c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:10 devstack sudo[105407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c 1073741824
Sep 11 23:20:10 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (b0d4d178-8513-4b78-8ad9-532331473785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17254505-0c2a-4ee1-83ea-852a8ba74194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17254505-0c2a-4ee1-83ea-852a8ba74194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040764286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bc671f-871a-4f57-8b54-399e6e0fddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fb3f25-0e2d-46a5-9d59-a828cfa058f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fb3f25-0e2d-46a5-9d59-a828cfa058f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc71baa-1e61-4472-bac4-9409a810c096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc71baa-1e61-4472-bac4-9409a810c096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6bc671f-871a-4f57-8b54-399e6e0fddc3', 'volume_name': 'volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8765e3-79b7-4f28-87e0-af670ac6182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f8765e3-79b7-4f28-87e0-af670ac6182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771aa4f1-473f-47d4-83ff-f9485bbabc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume f6bc671f-871a-4f57-8b54-399e6e0fddc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3', 'volume_size': 1}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:11 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c 1073741824" returned: 0 in 0.495s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:11 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c
Sep 11 23:20:11 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (84e7b4b0-269c-4e17-86d5-7160b48fe64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caf99e3-c33a-4ad1-8441-5d60d9333acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9caf99e3-c33a-4ad1-8441-5d60d9333acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719963955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c4e09-601c-4814-a2ed-481e9c72ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf512654-53db-4faa-97e1-a0025f320da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf512654-53db-4faa-97e1-a0025f320da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2bf8c6-656f-45e5-9f6a-631d6d9a9732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2bf8c6-656f-45e5-9f6a-631d6d9a9732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da8c4e09-601c-4814-a2ed-481e9c72ce90', 'volume_name': 'volume-da8c4e09-601c-4814-a2ed-481e9c72ce90', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32530e20-a352-455b-ba1a-54d012cfca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32530e20-a352-455b-ba1a-54d012cfca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221d9d52-0c64-45d9-a04c-cd397cdc90c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume da8c4e09-601c-4814-a2ed-481e9c72ce90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da8c4e09-601c-4814-a2ed-481e9c72ce90', 'volume_size': 1}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:11 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040764286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6bc671f-871a-4f57-8b54-399e6e0fddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume f6bc671f-871a-4f57-8b54-399e6e0fddc3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdb44be-da98-4ceb-a65d-1fb0fb0f8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9c0311-48b7-4956-823f-d88c5620ec8c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 1073741824
Sep 11 23:20:11 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f109a2-cd8c-4a2e-804f-d8b3e53462a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-0d9c0311-48b7-4956-823f-d88c5620ec8c (0d9c0311-48b7-4956-823f-d88c5620ec8c): created successfully
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f109a2-cd8c-4a2e-804f-d8b3e53462a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (23427696-d7a1-4165-8a44-5d39678582ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-062b2ee8-1692-4484-873a-80ca2f003a0e tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (b5493aa7-101d-4183-84d7-aeb819b9d6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48cc5e9-4e3d-4ba1-abc7-4763405da52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48cc5e9-4e3d-4ba1-abc7-4763405da52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659544015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce08476-71d0-4538-a674-1fdb724cd924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:12Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68472aee-1b39-46aa-99f1-697aa39f42be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68472aee-1b39-46aa-99f1-697aa39f42be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688bbd02-3684-4b3e-b872-f830416ae63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (688bbd02-3684-4b3e-b872-f830416ae63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce08476-71d0-4538-a674-1fdb724cd924', 'volume_name': 'volume-8ce08476-71d0-4538-a674-1fdb724cd924', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0998dd-8e6c-49c2-a33b-bdbc6be0c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0998dd-8e6c-49c2-a33b-bdbc6be0c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9428782-549c-4a7c-9e30-6e7fc0ada0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume 8ce08476-71d0-4538-a674-1fdb724cd924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce08476-71d0-4538-a674-1fdb724cd924', 'volume_size': 1}
Sep 11 23:20:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:12 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 1073741824" returned: 0 in 0.508s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:12 devstack sudo[105421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3
Sep 11 23:20:12 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (624afcda-c758-43a1-bc37-4a3a420461a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514363a1-90c7-4ea4-b1f2-6d4c0c649f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514363a1-90c7-4ea4-b1f2-6d4c0c649f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1809682650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd562819-293e-4739-8a80-8c1d10bb9cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:12Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b76bc8f-7d29-4b31-84b4-4ab17dbe1d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b76bc8f-7d29-4b31-84b4-4ab17dbe1d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463bddda-e0a5-4b8c-bc10-ac8cfdb4ebbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463bddda-e0a5-4b8c-bc10-ac8cfdb4ebbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd562819-293e-4739-8a80-8c1d10bb9cea', 'volume_name': 'volume-dd562819-293e-4739-8a80-8c1d10bb9cea', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebf73af-2a12-4d3b-9fdf-92b97069b25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebf73af-2a12-4d3b-9fdf-92b97069b25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90083bdc-12b1-45f2-9be8-073fc2c4adde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume dd562819-293e-4739-8a80-8c1d10bb9cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd562819-293e-4739-8a80-8c1d10bb9cea', 'volume_size': 1}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:12 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.925s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-719963955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da8c4e09-601c-4814-a2ed-481e9c72ce90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:11Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume da8c4e09-601c-4814-a2ed-481e9c72ce90 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:12 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771aa4f1-473f-47d4-83ff-f9485bbabc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 1073741824
Sep 11 23:20:12 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b78817-254d-431f-ad19-b881b5479d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:12 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 (f6bc671f-871a-4f57-8b54-399e6e0fddc3): created successfully
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b78817-254d-431f-ad19-b881b5479d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (b0d4d178-8513-4b78-8ad9-532331473785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e22714bf-f986-40e2-a5cb-a0db692bbebd tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:12 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 1073741824" returned: 0 in 0.421s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:12 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90
Sep 11 23:20:12 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:13 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90" returned: 0 in 0.239s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659544015',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce08476-71d0-4538-a674-1fdb724cd924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:12Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume 8ce08476-71d0-4538-a674-1fdb724cd924 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221d9d52-0c64-45d9-a04c-cd397cdc90c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da8c4e09-601c-4814-a2ed-481e9c72ce90', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:13 devstack sudo[105433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 1073741824
Sep 11 23:20:13 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5652cb99-0725-4c14-99f9-aef61cff8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 (da8c4e09-601c-4814-a2ed-481e9c72ce90): created successfully
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5652cb99-0725-4c14-99f9-aef61cff8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (84e7b4b0-269c-4e17-86d5-7160b48fe64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-88a905ec-5363-454d-99d6-69af2d1026a8 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:13 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 1073741824" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:13 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924
Sep 11 23:20:13 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:13 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1809682650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd562819-293e-4739-8a80-8c1d10bb9cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24b3b8b2b7a46549de5ad2658069e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:12Z,use_quota=True,user_id='d2123cd922474f18964154580c879d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Creating volume dd562819-293e-4739-8a80-8c1d10bb9cea {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9428782-549c-4a7c-9e30-6e7fc0ada0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce08476-71d0-4538-a674-1fdb724cd924', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9192825b-3b13-4b43-91da-ffbad0a0f5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:13 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea 1073741824
Sep 11 23:20:13 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-8ce08476-71d0-4538-a674-1fdb724cd924 (8ce08476-71d0-4538-a674-1fdb724cd924): created successfully
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9192825b-3b13-4b43-91da-ffbad0a0f5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (b5493aa7-101d-4183-84d7-aeb819b9d6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-43e516ac-323c-4810-8de9-69298adef210 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:14 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea 1073741824" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:14 devstack sudo[105482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea
Sep 11 23:20:14 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:14 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90083bdc-12b1-45f2-9be8-073fc2c4adde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd562819-293e-4739-8a80-8c1d10bb9cea', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ea3a4-00d9-405a-aabe-82ce9b7e3eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Volume volume-dd562819-293e-4739-8a80-8c1d10bb9cea (dd562819-293e-4739-8a80-8c1d10bb9cea): created successfully
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ea3a4-00d9-405a-aabe-82ce9b7e3eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Flow 'volume_create_manager' (624afcda-c758-43a1-bc37-4a3a420461a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a0fa7a44-1c1d-430f-9758-11f0140bd86d tempest-CreateVolumesFromSnapshotTest-872610189 None] Created volume successfully.
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-dd562819-293e-4739-8a80-8c1d10bb9cea-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-dd562819-293e-4739-8a80-8c1d10bb9cea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-dd562819-293e-4739-8a80-8c1d10bb9cea" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-dd562819-293e-4739-8a80-8c1d10bb9cea" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b8f270-0aaa-4cce-a229-145050e9b47f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:15 devstack sudo[105485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea
Sep 11 23:20:15 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:16 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:16 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea
Sep 11 23:20:16 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:16 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-dd562819-293e-4739-8a80-8c1d10bb9cea" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-dd562819-293e-4739-8a80-8c1d10bb9cea" released by "delete_volume" :: held 0.631s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['5a0f0939-2996-43e1-9e94-9e9cd09f13b3', '7fc6064b-132a-4613-8ae9-6f283b04f4f6', '643f977b-9ef2-4bd3-a358-d2eb11cdc454', 'f6208ee1-1945-4a3f-b1e4-602c9e58dace'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:16 devstack sudo[105494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:16 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:16 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0db52943-d19a-4754-a4ba-870ed6201694 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-dd562819-293e-4739-8a80-8c1d10bb9cea-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-8ce08476-71d0-4538-a674-1fdb724cd924-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-8ce08476-71d0-4538-a674-1fdb724cd924-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-8ce08476-71d0-4538-a674-1fdb724cd924" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-8ce08476-71d0-4538-a674-1fdb724cd924" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b8f2c0-7824-4b14-8ff1-1ffb1dc8b93e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:16 devstack sudo[105497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924
Sep 11 23:20:16 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:17 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924" returned: 0 in 0.341s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:17 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924
Sep 11 23:20:17 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:17 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8ce08476-71d0-4538-a674-1fdb724cd924" returned: 0 in 0.238s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-8ce08476-71d0-4538-a674-1fdb724cd924" released by "delete_volume" :: held 0.618s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['83c78bed-8eeb-493b-bbc8-f118c57fad43', 'eb0d2041-0a74-4a51-94d2-bfd69d4d00c5', 'db78a4fd-3248-4f45-be13-25ae6bc9d1aa', '58b39f6f-d1cd-40c1-87dc-387c8d050720'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:17 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:17 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:17 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-da1a2af0-fb7d-47d1-91f5-624d4a66d794 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-8ce08476-71d0-4538-a674-1fdb724cd924-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-da8c4e09-601c-4814-a2ed-481e9c72ce90-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-da8c4e09-601c-4814-a2ed-481e9c72ce90-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-da8c4e09-601c-4814-a2ed-481e9c72ce90" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-da8c4e09-601c-4814-a2ed-481e9c72ce90" acquired by "delete_volume" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ee789-58cf-44b9-93ec-f60c633fd4ea]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:18 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90
Sep 11 23:20:18 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:18 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:18 devstack sudo[105513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90
Sep 11 23:20:18 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:18 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-da8c4e09-601c-4814-a2ed-481e9c72ce90" returned: 0 in 0.232s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-da8c4e09-601c-4814-a2ed-481e9c72ce90" released by "delete_volume" :: held 0.612s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['717858ae-ea11-4dbb-ae8e-79ef00c8d87a', '74c73e51-9aa5-4665-acbc-866d251d01ef', 'ab35ed92-6f3c-4538-9c85-e9a7c04fc972', '1e9dd27a-98cf-4851-a275-00d719a8ca28'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:18 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:18 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:18 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.223s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-389b49ef-f9d8-4312-a704-1d0830e2ba06 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-da8c4e09-601c-4814-a2ed-481e9c72ce90-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-f6bc671f-871a-4f57-8b54-399e6e0fddc3-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-f6bc671f-871a-4f57-8b54-399e6e0fddc3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-f6bc671f-871a-4f57-8b54-399e6e0fddc3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-f6bc671f-871a-4f57-8b54-399e6e0fddc3" acquired by "delete_volume" :: waited 0.012s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7a06d-9ad2-4a51-a37b-794edeae6081]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:19 devstack sudo[105519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3
Sep 11 23:20:19 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:19 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3" returned: 0 in 0.346s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:19 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3
Sep 11 23:20:19 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:19 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f6bc671f-871a-4f57-8b54-399e6e0fddc3" returned: 0 in 0.227s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-f6bc671f-871a-4f57-8b54-399e6e0fddc3" released by "delete_volume" :: held 0.609s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['9fd6b1e7-8c6c-43b8-81d4-d47fac1508c6', 'd822f651-8974-4bd7-a3ed-e3efe0e11fa4', 'f86b8950-3137-4bda-ad46-7f89be052580', '420ef207-d379-4820-9f25-d52632400840'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:19 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:19 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:20 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-64f847b0-ba3d-4e06-bbb3-32dab304f536 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-f6bc671f-871a-4f57-8b54-399e6e0fddc3-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-0d9c0311-48b7-4956-823f-d88c5620ec8c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-0d9c0311-48b7-4956-823f-d88c5620ec8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-0d9c0311-48b7-4956-823f-d88c5620ec8c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-0d9c0311-48b7-4956-823f-d88c5620ec8c" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf7b8c-39d0-4101-be70-18c5307dc785]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:20 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c
Sep 11 23:20:20 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:20 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c" returned: 0 in 0.351s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:20 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c
Sep 11 23:20:20 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:20 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0d9c0311-48b7-4956-823f-d88c5620ec8c" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-0d9c0311-48b7-4956-823f-d88c5620ec8c" released by "delete_volume" :: held 0.629s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:20 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['6097bcef-6933-4c81-8b7a-d3f12187114a', '244dd55a-0612-4293-8c02-e855252fd277', '5b194111-5d36-4037-adf8-639f95946e7e', '7d1f1afa-f1e9-4b57-b8fd-61bdc3955554'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:21 devstack sudo[105538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:21 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:21 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-f5dc083c-ce8c-49bb-99a5-958fbad22029 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-0d9c0311-48b7-4956-823f-d88c5620ec8c-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-a16545ab-010b-45dc-84b4-c32f617885cc-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-a16545ab-010b-45dc-84b4-c32f617885cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-a16545ab-010b-45dc-84b4-c32f617885cc" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-a16545ab-010b-45dc-84b4-c32f617885cc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleting offline snapshot a16545ab-010b-45dc-84b4-c32f617885cc of volume 6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] snapshot_file for this snap is: volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22b59a3-cf44-493e-b037-a85a33acd889]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:21 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc
Sep 11 23:20:21 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:21 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b3457a2-1052-43ff-a188-e810893427e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cd0efb-e7f6-48eb-b8e9-ac1580610793]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:21 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4
Sep 11 23:20:21 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:22 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:22 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc
Sep 11 23:20:22 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:22 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc" returned: 0 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:22 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc
Sep 11 23:20:22 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:22 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4.a16545ab-010b-45dc-84b4-c32f617885cc" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-a16545ab-010b-45dc-84b4-c32f617885cc" released by "_delete_snapshot" :: held 1.468s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" released by "delete_snapshot" :: held 1.495s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:22 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['eea27c57-d033-4feb-8af4-7dba9f71fc52', '8f974680-25f4-4785-bde0-9e77105ac860', '782de966-ef0f-488c-b08c-68bd4046b0b6', '802a855f-1cd2-4422-92e7-3c404b378034'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Delete snapshot completed successfully.
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c77d3c0d-38d3-41d8-aaad-19d81090d324 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-a16545ab-010b-45dc-84b4-c32f617885cc-delete_snapshot" released by "delete_snapshot" :: held 1.637s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-6b3457a2-1052-43ff-a188-e810893427e4-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-6b3457a2-1052-43ff-a188-e810893427e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0806bfbf-2220-45aa-9c88-b433f7bbc8fd]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:23 devstack sudo[105560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4
Sep 11 23:20:23 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:24 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:24 devstack sudo[105565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4
Sep 11 23:20:24 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:24 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6b3457a2-1052-43ff-a188-e810893427e4" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-quobyte-6b3457a2-1052-43ff-a188-e810893427e4" released by "delete_volume" :: held 0.700s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Created reservations ['46db60ce-adb9-4552-86f4-04d9915ea349', '4fc1a438-58f6-491e-9d64-d82e6fe9b77d', 'ffc34d36-4f4e-40e7-8d67-52af7e055b10', '88282fee-343e-4a3a-8b6e-c1c6216ed0c7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:24 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:24 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:24 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Deleted volume successfully.
Sep 11 23:20:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70861012-6e95-4339-a3e9-5538a4d34c91 tempest-CreateVolumesFromSnapshotTest-872610189 None] Lock "cinder-6b3457a2-1052-43ff-a188-e810893427e4-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (74046d01-a618-4eb7-b840-2c4835a35801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6a292-c2e4-4778-ac1a-71c6f42c56a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a6a292-c2e4-4778-ac1a-71c6f42c56a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155771293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60256d1e-464d-4dfd-954d-a974d90acad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:27Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eeed6d-efb0-41cd-bf8f-ba8c9f802b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16eeed6d-efb0-41cd-bf8f-ba8c9f802b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8588ba-badb-414f-9a0a-361bc7a68354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8588ba-badb-414f-9a0a-361bc7a68354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60256d1e-464d-4dfd-954d-a974d90acad8', 'volume_name': 'volume-60256d1e-464d-4dfd-954d-a974d90acad8', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211e1480-e506-48f0-bd8d-0458775efac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (211e1480-e506-48f0-bd8d-0458775efac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a86752-f298-4bd2-9d4a-2d25dcd3f901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume 60256d1e-464d-4dfd-954d-a974d90acad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60256d1e-464d-4dfd-954d-a974d90acad8', 'volume_size': 1}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1155771293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60256d1e-464d-4dfd-954d-a974d90acad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:27Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume 60256d1e-464d-4dfd-954d-a974d90acad8 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:27 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 1073741824
Sep 11 23:20:27 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:28 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 1073741824" returned: 0 in 0.420s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:28 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8
Sep 11 23:20:28 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:28 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8" returned: 0 in 0.268s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a86752-f298-4bd2-9d4a-2d25dcd3f901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60256d1e-464d-4dfd-954d-a974d90acad8', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae3b7f2-39af-4d40-aced-4073981cb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-60256d1e-464d-4dfd-954d-a974d90acad8 (60256d1e-464d-4dfd-954d-a974d90acad8): created successfully
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae3b7f2-39af-4d40-aced-4073981cb96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (74046d01-a618-4eb7-b840-2c4835a35801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cb92799a-58ac-4552-a067-abc0f1d03fa7 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (008b7635-f6a0-4508-9cf1-f04db4be6faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30452385-0506-4a95-8f2f-f4b9d063218e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30452385-0506-4a95-8f2f-f4b9d063218e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146181498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31498b0b-1a92-41dc-bdb0-e1d036cf639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31498b0b-1a92-41dc-bdb0-e1d036cf639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e709505-b49f-40f2-93a9-c32279b2c851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e709505-b49f-40f2-93a9-c32279b2c851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e', 'volume_name': 'volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdad8d3-fc9e-49b3-bbad-99d7dbb31ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cdad8d3-fc9e-49b3-bbad-99d7dbb31ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f724853-5a30-4c7e-b1ff-f2069af6e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume 8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e', 'volume_size': 1}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2146181498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume 8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:29 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:29 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e 1073741824
Sep 11 23:20:29 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (ed3ee536-0de6-4dcf-9a95-1cd6bab2b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3215cd0-3614-4c40-b502-f78cc58ad543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3215cd0-3614-4c40-b502-f78cc58ad543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1780049285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55267fb9-8b72-4078-aba2-47e1f1e22f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19ab342-566a-4000-bcdb-1bd00cf78aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19ab342-566a-4000-bcdb-1bd00cf78aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f27fbe4-8492-4754-bb11-8df0909ef152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f27fbe4-8492-4754-bb11-8df0909ef152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55267fb9-8b72-4078-aba2-47e1f1e22f4e', 'volume_name': 'volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e86d6f-67a0-45be-99dd-377a7cf0bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e86d6f-67a0-45be-99dd-377a7cf0bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34711f6e-a584-44f8-931a-e37f9884d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume 55267fb9-8b72-4078-aba2-47e1f1e22f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e', 'volume_size': 1}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:29 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e 1073741824" returned: 0 in 0.566s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:29 devstack sudo[105593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e
Sep 11 23:20:29 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (93d52093-9dab-45ca-9af2-fdfef615fe22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be54cd6-eaba-477f-80b3-26185997cf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be54cd6-eaba-477f-80b3-26185997cf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419060810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f42e92-760a-4834-a4a4-9b0879c9d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f99053-9749-469e-b602-ce4301ddc530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f99053-9749-469e-b602-ce4301ddc530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc3383b-82f6-4026-8295-5fc52d7b18d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc3383b-82f6-4026-8295-5fc52d7b18d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f42e92-760a-4834-a4a4-9b0879c9d50b', 'volume_name': 'volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9f4466-cac1-4fd6-9d94-0c735024e365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9f4466-cac1-4fd6-9d94-0c735024e365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5722a-015f-40fe-9d25-a739b897d650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume a1f42e92-760a-4834-a4a4-9b0879c9d50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b', 'volume_size': 1}
Sep 11 23:20:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:30 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1780049285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55267fb9-8b72-4078-aba2-47e1f1e22f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:29Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume 55267fb9-8b72-4078-aba2-47e1f1e22f4e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f724853-5a30-4c7e-b1ff-f2069af6e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc58fd27-9f14-442d-bad8-7fff961a4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e 1073741824
Sep 11 23:20:30 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e (8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e): created successfully
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc58fd27-9f14-442d-bad8-7fff961a4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (008b7635-f6a0-4508-9cf1-f04db4be6faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4d83eb06-de9d-4ebb-8831-3c4a549d8a70 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (4797fc5a-e00e-44d1-aa2f-5c7a7dc2b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef235b2a-2b03-4ae3-98f0-31b954a58b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef235b2a-2b03-4ae3-98f0-31b954a58b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445621692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721264a3-9623-4721-b96a-e7a6d6aa16ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04b2bb-7354-4076-905c-9d1cd6c4b97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb04b2bb-7354-4076-905c-9d1cd6c4b97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89270891-dc1c-4dc8-bc22-6eb39504f523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89270891-dc1c-4dc8-bc22-6eb39504f523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '721264a3-9623-4721-b96a-e7a6d6aa16ab', 'volume_name': 'volume-721264a3-9623-4721-b96a-e7a6d6aa16ab', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6f92c-6d97-4081-a2d1-ff4216e3713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c6f92c-6d97-4081-a2d1-ff4216e3713c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe93f2-1d25-4d0d-9133-2a172bcf8b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume 721264a3-9623-4721-b96a-e7a6d6aa16ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-721264a3-9623-4721-b96a-e7a6d6aa16ab', 'volume_size': 1}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:30 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e 1073741824" returned: 0 in 0.568s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:30 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e
Sep 11 23:20:30 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (4388d90c-619d-4860-92b3-0912bcf2a84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c90c4d-ffe7-4d1e-9c5d-c2344ff8d5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c90c4d-ffe7-4d1e-9c5d-c2344ff8d5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110557727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e416288-46b9-4fe6-8dd7-3807e3c0af42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:31Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fb029a-7631-4b96-a196-934ac9d95785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6fb029a-7631-4b96-a196-934ac9d95785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70b74bb-51f5-411d-97a2-bd2968c008a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70b74bb-51f5-411d-97a2-bd2968c008a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e416288-46b9-4fe6-8dd7-3807e3c0af42', 'volume_name': 'volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36047db5-b2e8-4a5e-bdf3-5034d0dc0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36047db5-b2e8-4a5e-bdf3-5034d0dc0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee48efbd-fa4b-4ef1-87de-ae15c6434658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume 8e416288-46b9-4fe6-8dd7-3807e3c0af42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42', 'volume_size': 1}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:30 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-419060810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f42e92-760a-4834-a4a4-9b0879c9d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume a1f42e92-760a-4834-a4a4-9b0879c9d50b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34711f6e-a584-44f8-931a-e37f9884d675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack sudo[105605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b 1073741824
Sep 11 23:20:30 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32e8e00-6f96-4c34-8d99-396cfa9b1445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e (55267fb9-8b72-4078-aba2-47e1f1e22f4e): created successfully
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32e8e00-6f96-4c34-8d99-396cfa9b1445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:30 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (ed3ee536-0de6-4dcf-9a95-1cd6bab2b30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f77ab6c9-e659-495b-ae18-765dc9c04b63 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:31 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b 1073741824" returned: 0 in 0.412s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:31 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b
Sep 11 23:20:31 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:31 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445621692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=721264a3-9623-4721-b96a-e7a6d6aa16ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:30Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume 721264a3-9623-4721-b96a-e7a6d6aa16ab {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:31 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:31 devstack sudo[105613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab 1073741824
Sep 11 23:20:31 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b5722a-015f-40fe-9d25-a739b897d650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7a2464-7b5c-40d9-84c8-66ebd9a22988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:31 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b (a1f42e92-760a-4834-a4a4-9b0879c9d50b): created successfully
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7a2464-7b5c-40d9-84c8-66ebd9a22988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:31 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (93d52093-9dab-45ca-9af2-fdfef615fe22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:31 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f3dedb29-5077-4357-b190-062c6e5c03d8 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:32 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab 1073741824" returned: 0 in 0.432s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:32 devstack sudo[105618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab
Sep 11 23:20:32 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:32 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2110557727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e416288-46b9-4fe6-8dd7-3807e3c0af42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77871d179514e68a4e2989350dd06c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:31Z,use_quota=True,user_id='920097e0467e4240b2c0938f784bb604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Creating volume 8e416288-46b9-4fe6-8dd7-3807e3c0af42 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:32 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dfe93f2-1d25-4d0d-9133-2a172bcf8b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-721264a3-9623-4721-b96a-e7a6d6aa16ab', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:32 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 1073741824
Sep 11 23:20:32 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59665e4a-46ec-437e-9d45-b600a41fb562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-721264a3-9623-4721-b96a-e7a6d6aa16ab (721264a3-9623-4721-b96a-e7a6d6aa16ab): created successfully
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59665e4a-46ec-437e-9d45-b600a41fb562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (4797fc5a-e00e-44d1-aa2f-5c7a7dc2b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c3d82918-5a3d-4683-a863-56445c5229e9 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:32 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 1073741824" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:32 devstack sudo[105626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42
Sep 11 23:20:32 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:33 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42" returned: 0 in 0.235s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee48efbd-fa4b-4ef1-87de-ae15c6434658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e15c52-5b83-4dfb-89ed-e143b18153fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Volume volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 (8e416288-46b9-4fe6-8dd7-3807e3c0af42): created successfully
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e15c52-5b83-4dfb-89ed-e143b18153fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Flow 'volume_create_manager' (4388d90c-619d-4860-92b3-0912bcf2a84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-46b89366-2b80-4dbe-965d-71b53b72f90e tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created volume successfully.
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-8e416288-46b9-4fe6-8dd7-3807e3c0af42-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-8e416288-46b9-4fe6-8dd7-3807e3c0af42-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-8e416288-46b9-4fe6-8dd7-3807e3c0af42" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-8e416288-46b9-4fe6-8dd7-3807e3c0af42" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5570e7ae-ff24-43ab-a94f-331131c7b204]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:34 devstack sudo[105629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42
Sep 11 23:20:34 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:34 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42" returned: 0 in 0.361s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:34 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42
Sep 11 23:20:34 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:34 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8e416288-46b9-4fe6-8dd7-3807e3c0af42" returned: 0 in 0.239s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-8e416288-46b9-4fe6-8dd7-3807e3c0af42" released by "delete_volume" :: held 0.644s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['e7814659-1c71-4b54-92f6-bc4fe8026ebb', '524e3ee2-ff82-42d4-8de2-fe60de0f4ad2', '009ea072-b2e2-4276-9ae6-a0d383565d30', '0704c1b1-07c3-4994-8811-c9ad7ad01f96'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:34 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:34 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:35 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.243s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:35 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a279a8b0-691e-46fb-b9af-72c5fd7799a4 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-8e416288-46b9-4fe6-8dd7-3807e3c0af42-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-721264a3-9623-4721-b96a-e7a6d6aa16ab-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-721264a3-9623-4721-b96a-e7a6d6aa16ab-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-721264a3-9623-4721-b96a-e7a6d6aa16ab" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-721264a3-9623-4721-b96a-e7a6d6aa16ab" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8521aac8-7b48-4052-9e80-67c7b9f4b54c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:35 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab
Sep 11 23:20:35 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:35 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:35 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab
Sep 11 23:20:35 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:35 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-721264a3-9623-4721-b96a-e7a6d6aa16ab" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-721264a3-9623-4721-b96a-e7a6d6aa16ab" released by "delete_volume" :: held 0.618s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['d0c1cfcf-69e8-4a99-a826-553ec86d8f05', '8dd47524-75bf-4929-a9fa-8eeb01269a7b', '5b528b04-048c-4ca6-b3f4-c782970299a7', '15c9ea37-8f44-4462-8d03-de101c23aca8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:36 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:36 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:36 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a66c4d6a-3711-45f3-ad36-143047566da2 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-721264a3-9623-4721-b96a-e7a6d6aa16ab-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-a1f42e92-760a-4834-a4a4-9b0879c9d50b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-a1f42e92-760a-4834-a4a4-9b0879c9d50b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-a1f42e92-760a-4834-a4a4-9b0879c9d50b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-a1f42e92-760a-4834-a4a4-9b0879c9d50b" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b213e5b9-8dea-453a-8182-5c3dbec1dd98]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:36 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b
Sep 11 23:20:36 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:36 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b" returned: 0 in 0.337s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:36 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b
Sep 11 23:20:36 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:37 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1f42e92-760a-4834-a4a4-9b0879c9d50b" returned: 0 in 0.243s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-a1f42e92-760a-4834-a4a4-9b0879c9d50b" released by "delete_volume" :: held 0.616s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['1befa4b2-97a4-4593-9f9a-38a2a8959e88', '9a067ca3-7e8e-40a9-9a1a-f19731fd844c', '5844b5ec-6b42-4ea8-bc93-5a76c6a2e6f1', 'bf0d7382-7aa8-47b9-966f-1e3634d82f7b'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:37 devstack sudo[105660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:37 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:37 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:37 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1bd20c3d-b700-4fb4-a780-b48cee985559 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-a1f42e92-760a-4834-a4a4-9b0879c9d50b-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-55267fb9-8b72-4078-aba2-47e1f1e22f4e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-55267fb9-8b72-4078-aba2-47e1f1e22f4e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-55267fb9-8b72-4078-aba2-47e1f1e22f4e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-55267fb9-8b72-4078-aba2-47e1f1e22f4e" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fead1d7c-9ed9-4a45-b1ba-b0c3ca68250b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:37 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e
Sep 11 23:20:37 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:37 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:37 devstack sudo[105668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e
Sep 11 23:20:37 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:38 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55267fb9-8b72-4078-aba2-47e1f1e22f4e" returned: 0 in 0.238s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-55267fb9-8b72-4078-aba2-47e1f1e22f4e" released by "delete_volume" :: held 0.612s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['3d296372-59f0-4cd7-a58a-2a31baaf11a0', 'fa9d8232-9deb-49f7-a179-91aeab045ff4', '2a11c98b-a2c3-47d2-9d20-c39cf12ba16d', '7138e860-16e3-4138-93ec-7caba893d721'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:38 devstack sudo[105671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:38 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:38 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.227s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e2212e02-56cc-40f5-aa57-a5e35a58dad6 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-55267fb9-8b72-4078-aba2-47e1f1e22f4e-delete_volume" released by "delete_volume" :: held 1.016s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a41ffd9-c41f-45be-98c7-78f60e0d8e48]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:38 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e
Sep 11 23:20:38 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:39 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" returned: 0 in 0.366s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:39 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e
Sep 11 23:20:39 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:39 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e" released by "delete_volume" :: held 0.633s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['53032a00-eb0f-4b54-a23f-91cc7051f88c', '75b06624-a6b1-44bb-9a36-e8b082963318', '99cd5006-8651-4aad-9265-4f6d019b59ac', '84538887-2402-4996-94db-70f05530d2ad'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:39 devstack sudo[105683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:39 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:39 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.227s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2cccb700-7008-4ee2-a4fd-a87b71e3ab58 tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-8cb1196e-91ab-4b12-8a4e-1944fa3b5d4e-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-60256d1e-464d-4dfd-954d-a974d90acad8-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-60256d1e-464d-4dfd-954d-a974d90acad8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "cinder-quobyte-60256d1e-464d-4dfd-954d-a974d90acad8" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-60256d1e-464d-4dfd-954d-a974d90acad8" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3b809e-ba04-4514-b98b-3a4fdf58c8ed]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:40 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8
Sep 11 23:20:40 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:40 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:40 devstack sudo[105691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8
Sep 11 23:20:40 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:40 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-60256d1e-464d-4dfd-954d-a974d90acad8" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-quobyte-60256d1e-464d-4dfd-954d-a974d90acad8" released by "delete_volume" :: held 0.615s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Created reservations ['9d1594f4-e005-4e20-ad5e-f977e4a7a219', '220dddc3-84a4-47c5-9bf6-6e10b6e3d2fe', 'ab0e810c-afe6-416a-9abf-32b14b5625fb', 'be425ef2-b428-4ca7-92d3-4dc88c2ff245'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:40 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:40 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:40 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.227s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Deleted volume successfully.
Sep 11 23:20:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-34bd6dcf-2157-40bc-a252-d98089bdc27a tempest-CreateVolumesFromSourceVolumeTest-1461191846 None] Lock "cinder-60256d1e-464d-4dfd-954d-a974d90acad8-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Flow 'volume_create_manager' (74475588-b8ee-4ad2-87d2-b0eab4b249ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ec2e2d-1792-4122-80d4-cb3015ee9375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ec2e2d-1792-4122-80d4-cb3015ee9375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f63844-217e-4419-a0c6-0be2217225e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27d869422f94763a8054a698ebabbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:46Z,use_quota=True,user_id='d008c09cba74400fba28950452364c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0925a9cf-8d59-41e5-9367-d1425b6f5962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0925a9cf-8d59-41e5-9367-d1425b6f5962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabebd72-ebce-47f6-b138-d6b20face32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabebd72-ebce-47f6-b138-d6b20face32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70f63844-217e-4419-a0c6-0be2217225e9', 'volume_name': 'volume-70f63844-217e-4419-a0c6-0be2217225e9', 'volume_size': 1, 'image_id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82163bbcffc558df3acc4da931433abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27d869422f94763a8054a698ebabbb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b4444eaee7165a5b9dbc8c35b1fc6bd244d3567cd0a4656115c41293a788fe0a8c19a59b0f5d83176a54c750b382928635fc9b909410ddc6b58ac8ba592ddbe', 'id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'created_at': datetime.datetime(2026, 9, 11, 21, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3c70f29-cc11-41a0-8d3e-eb044f590907/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb62e3590>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d8f464-0e50-4297-9e69-111eab1b8cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d8f464-0e50-4297-9e69-111eab1b8cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0f4a87-6d1a-4867-8d8a-6cd757bdb894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:45 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Volume 70f63844-217e-4419-a0c6-0be2217225e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70f63844-217e-4419-a0c6-0be2217225e9', 'volume_size': 1, 'image_id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82163bbcffc558df3acc4da931433abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27d869422f94763a8054a698ebabbb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b4444eaee7165a5b9dbc8c35b1fc6bd244d3567cd0a4656115c41293a788fe0a8c19a59b0f5d83176a54c750b382928635fc9b909410ddc6b58ac8ba592ddbe', 'id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'created_at': datetime.datetime(2026, 9, 11, 21, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3c70f29-cc11-41a0-8d3e-eb044f590907/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb62e3590>}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Trying to clone 70f63844-217e-4419-a0c6-0be2217225e9 from image a3c70f29-cc11-41a0-8d3e-eb044f590907 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:20:45 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a24b5-c9a7-4ed5-9a8b-0a58a6907928]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:46 devstack sudo[105700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:46 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:46 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:46 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:46 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:46 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:46 devstack sudo[105707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:46 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:46 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Temporary image a3c70f29-cc11-41a0-8d3e-eb044f590907 is fetched for user d008c09cba74400fba28950452364c3f. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989ae75-9453-475c-ba95-01d37769aac9]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:46 devstack sudo[105712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:46 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:46 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:47 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:47 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:47 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f63844-217e-4419-a0c6-0be2217225e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c27d869422f94763a8054a698ebabbb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:46Z,use_quota=True,user_id='d008c09cba74400fba28950452364c3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Creating volume 70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:47 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:47 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1073741824
Sep 11 23:20:47 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:47 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1073741824" returned: 0 in 0.411s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:47 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9
Sep 11 23:20:47 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:47 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9" returned: 0 in 0.229s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Attempting download of a3c70f29-cc11-41a0-8d3e-eb044f590907 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}])) to volume 70f63844-217e-4419-a0c6-0be2217225e9. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[863d2ce1-37d9-4355-a93f-f852ae8614a8]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:48 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu
Sep 11 23:20:48 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:48 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:48 devstack sudo[105734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu
Sep 11 23:20:48 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:48 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu" returned: 1 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a3c70f29-cc11-41a0-8d3e-eb044f590907_uv2pgzxu' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0bf4c-e4ae-436f-8988-3b28c160243f]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:48 devstack sudo[105738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:48 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:49 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:49 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD
Sep 11 23:20:49 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:49 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] a3c70f29-cc11-41a0-8d3e-eb044f590907 was raw, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:49 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9
Sep 11 23:20:49 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:49 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9" returned: 0 in 0.427s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a3c70f29-cc11-41a0-8d3e-eb044f590907_921hsj4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:20:49 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 23:20:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:49 devstack sudo[105752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1G
Sep 11 23:20:49 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:50 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 1G" returned: 0 in 0.295s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Downloaded image a3c70f29-cc11-41a0-8d3e-eb044f590907 ((None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}])) to volume 70f63844-217e-4419-a0c6-0be2217225e9 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Temporary image a3c70f29-cc11-41a0-8d3e-eb044f590907 for user d008c09cba74400fba28950452364c3f is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Marking volume 70f63844-217e-4419-a0c6-0be2217225e9 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Copying metadata from image a3c70f29-cc11-41a0-8d3e-eb044f590907 to 70f63844-217e-4419-a0c6-0be2217225e9. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Creating volume glance metadata for volume 70f63844-217e-4419-a0c6-0be2217225e9 backed by image a3c70f29-cc11-41a0-8d3e-eb044f590907 with: {'image_id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '82163bbcffc558df3acc4da931433abb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0f4a87-6d1a-4867-8d8a-6cd757bdb894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f63844-217e-4419-a0c6-0be2217225e9', 'volume_size': 1, 'image_id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a3c70f29-cc11-41a0-8d3e-eb044f590907', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '82163bbcffc558df3acc4da931433abb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c27d869422f94763a8054a698ebabbb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4b4444eaee7165a5b9dbc8c35b1fc6bd244d3567cd0a4656115c41293a788fe0a8c19a59b0f5d83176a54c750b382928635fc9b909410ddc6b58ac8ba592ddbe', 'id': 'a3c70f29-cc11-41a0-8d3e-eb044f590907', 'created_at': datetime.datetime(2026, 9, 11, 21, 20, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 20, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a3c70f29-cc11-41a0-8d3e-eb044f590907/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb62e3590>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b1303c-0e8d-453e-bdc2-4f3c644d87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Volume volume-70f63844-217e-4419-a0c6-0be2217225e9 (70f63844-217e-4419-a0c6-0be2217225e9): created successfully
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b1303c-0e8d-453e-bdc2-4f3c644d87a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Flow 'volume_create_manager' (74475588-b8ee-4ad2-87d2-b0eab4b249ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ddd75ab7-0015-418c-a853-0ba5cd6b901b tempest-VolumeImageDependencyTests-1317897289 None] Created volume successfully.
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Acquiring lock "cinder-70f63844-217e-4419-a0c6-0be2217225e9-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "cinder-70f63844-217e-4419-a0c6-0be2217225e9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Acquiring lock "cinder-quobyte-70f63844-217e-4419-a0c6-0be2217225e9" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "cinder-quobyte-70f63844-217e-4419-a0c6-0be2217225e9" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:20:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2711d-8659-4dc8-8324-86e6f546ca84]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:51 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9
Sep 11 23:20:51 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:51 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9" returned: 0 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:51 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9
Sep 11 23:20:51 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:51 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-70f63844-217e-4419-a0c6-0be2217225e9" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "cinder-quobyte-70f63844-217e-4419-a0c6-0be2217225e9" released by "delete_volume" :: held 0.641s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Created reservations ['b578d0b8-010b-43f5-a875-6ad28a383732', '53a4ce16-5a3f-453d-aa0c-5b6c9cff5842', '5631965c-cb87-4e9e-985c-5701b5f3d490', '47b1f2c7-1dbe-4acd-aa6a-a185af61fc45'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:51 devstack sudo[105765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:20:51 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:51 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.244s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:51 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:20:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Deleted volume successfully.
Sep 11 23:20:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b01b03ff-7a25-49cb-80e0-82d4cc608011 tempest-VolumeImageDependencyTests-1317897289 None] Lock "cinder-70f63844-217e-4419-a0c6-0be2217225e9-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Flow 'volume_create_manager' (e01238cc-05f6-4703-ac45-5ccc35f34afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fee239-09c1-4d22-b553-507d1d39fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71fee239-09c1-4d22-b553-507d1d39fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fa2769-72a5-438e-8003-d73b4efa0ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8357d08f07445c89681659dad0e724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:55Z,use_quota=True,user_id='cef3306d641f44baac7fb23dce19e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52fa041-acae-4438-8037-86472a5d9c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52fa041-acae-4438-8037-86472a5d9c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55adc114-e910-4ee5-940c-819b57d5f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55adc114-e910-4ee5-940c-819b57d5f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fa2769-72a5-438e-8003-d73b4efa0ef2', 'volume_name': 'volume-64fa2769-72a5-438e-8003-d73b4efa0ef2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ad8db4-f52f-4aeb-8933-41297266b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86ad8db4-f52f-4aeb-8933-41297266b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8a1464-35b7-4ebe-9f29-b9f9f21935f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Volume 64fa2769-72a5-438e-8003-d73b4efa0ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fa2769-72a5-438e-8003-d73b4efa0ef2', 'volume_size': 1}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fa2769-72a5-438e-8003-d73b4efa0ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8357d08f07445c89681659dad0e724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:55Z,use_quota=True,user_id='cef3306d641f44baac7fb23dce19e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Creating volume 64fa2769-72a5-438e-8003-d73b4efa0ef2 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:55 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:55 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 1073741824
Sep 11 23:20:55 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:55 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 1073741824" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:55 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2
Sep 11 23:20:55 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:55 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8a1464-35b7-4ebe-9f29-b9f9f21935f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fa2769-72a5-438e-8003-d73b4efa0ef2', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63fc4f8-00de-4814-91d5-ac0f40fe44b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:55 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Volume volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 (64fa2769-72a5-438e-8003-d73b4efa0ef2): created successfully
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63fc4f8-00de-4814-91d5-ac0f40fe44b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Flow 'volume_create_manager' (e01238cc-05f6-4703-ac45-5ccc35f34afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-46d0b14f-7216-4591-9e74-9bcd83cf4ec7 tempest-CinderUnicodeTest-229588734 None] Created volume successfully.
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Flow 'volume_create_manager' (9438da62-a0f3-4781-b9a3-d3b268660bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9170bcd7-103e-4be1-b033-4f2c799cdc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9170bcd7-103e-4be1-b033-4f2c799cdc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1089881214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a5d425-36c1-4d5e-934b-0e495e2fe093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8357d08f07445c89681659dad0e724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:57Z,use_quota=True,user_id='cef3306d641f44baac7fb23dce19e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e436297-9a08-40ba-a0c5-79600e35e7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e436297-9a08-40ba-a0c5-79600e35e7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047d15e1-7bd5-414b-bad4-251b4d0b312f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047d15e1-7bd5-414b-bad4-251b4d0b312f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a5d425-36c1-4d5e-934b-0e495e2fe093', 'volume_name': 'volume-25a5d425-36c1-4d5e-934b-0e495e2fe093', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b147588-728d-4b70-b932-52970e4a54ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b147588-728d-4b70-b932-52970e4a54ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f0345-0c30-4c65-9bef-71e89376d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:56 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Volume 25a5d425-36c1-4d5e-934b-0e495e2fe093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a5d425-36c1-4d5e-934b-0e495e2fe093', 'volume_size': 1}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:20:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1089881214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a5d425-36c1-4d5e-934b-0e495e2fe093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8357d08f07445c89681659dad0e724d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:20:57Z,use_quota=True,user_id='cef3306d641f44baac7fb23dce19e19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Creating volume 25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:20:56 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:20:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:56 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 1073741824
Sep 11 23:20:56 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:57 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 1073741824" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:57 devstack sudo[105783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093
Sep 11 23:20:57 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:57 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603f0345-0c30-4c65-9bef-71e89376d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a5d425-36c1-4d5e-934b-0e495e2fe093', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab60e6c6-9c04-4c40-b93c-e9a29d4659dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:20:57 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Volume volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 (25a5d425-36c1-4d5e-934b-0e495e2fe093): created successfully
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab60e6c6-9c04-4c40-b93c-e9a29d4659dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Flow 'volume_create_manager' (9438da62-a0f3-4781-b9a3-d3b268660bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:20:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e7261829-ac1a-4651-8dc1-0b855205693a tempest-CinderUnicodeTest-229588734 None] Created volume successfully.
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Creating offline snapshot 8d12b527-4b08-412c-babc-cff0be1ee545 of volume 25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd63eea-ac3b-4330-85ba-8f394c537867]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:20:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:58 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093
Sep 11 23:20:58 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:58 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:58 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 1G
Sep 11 23:20:58 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:58 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 1G" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:58 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545
Sep 11 23:20:58 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:58 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545" returned: 0 in 0.276s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:58 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 is being set with open permissions: ugo+rw
Sep 11 23:20:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:58 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545
Sep 11 23:20:58 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:59 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545" returned: 0 in 0.229s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:59 devstack sudo[105805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info
Sep 11 23:20:59 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:59 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:59 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info is being set with open permissions: ugo+rw
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:20:59 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info
Sep 11 23:20:59 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:20:59 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.info" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:20:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:20:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0f66c622-b51d-41ff-89ff-98003c905958 tempest-CinderUnicodeTest-229588734 None] Create snapshot completed successfully
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-8d12b527-4b08-412c-babc-cff0be1ee545-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-8d12b527-4b08-412c-babc-cff0be1ee545-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-quobyte-8d12b527-4b08-412c-babc-cff0be1ee545" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-8d12b527-4b08-412c-babc-cff0be1ee545" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Deleting offline snapshot 8d12b527-4b08-412c-babc-cff0be1ee545 of volume 25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] snapshot_file for this snap is: volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed112d1d-aae3-403a-ad93-b30a0acc75b6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:00 devstack sudo[105811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545
Sep 11 23:21:00 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:00 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545" returned: 0 in 0.333s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25a5d425-36c1-4d5e-934b-0e495e2fe093(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38701a-004a-4c55-82f0-db620e9895a9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:00 devstack sudo[105816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093
Sep 11 23:21:00 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:00 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093" returned: 0 in 0.332s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:00 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545
Sep 11 23:21:00 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:01 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:01 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545
Sep 11 23:21:01 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:01 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093.8d12b527-4b08-412c-babc-cff0be1ee545" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-8d12b527-4b08-412c-babc-cff0be1ee545" released by "_delete_snapshot" :: held 1.308s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" released by "delete_snapshot" :: held 1.328s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Created reservations ['2d0c7957-932a-4abb-be50-de7e0847774d', '8c9e706a-0f39-43e3-9884-55260abd8645', '1885f6fc-2475-44f7-ba0e-6273f9377cce', '346b872f-83e8-4baf-9720-d3dec3135fb5'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Delete snapshot completed successfully.
Sep 11 23:21:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-80d70d51-9a9a-4748-a238-9e3042899bf6 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-8d12b527-4b08-412c-babc-cff0be1ee545-delete_snapshot" released by "delete_snapshot" :: held 1.449s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-25a5d425-36c1-4d5e-934b-0e495e2fe093-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-25a5d425-36c1-4d5e-934b-0e495e2fe093-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304f82b-4663-4ea9-b405-9f4188eecc60]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:02 devstack sudo[105829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093
Sep 11 23:21:02 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:02 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093" returned: 0 in 0.388s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:02 devstack sudo[105834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093
Sep 11 23:21:02 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:02 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-25a5d425-36c1-4d5e-934b-0e495e2fe093" returned: 0 in 0.251s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-25a5d425-36c1-4d5e-934b-0e495e2fe093" released by "delete_volume" :: held 0.695s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Created reservations ['b1bc0db7-a835-4887-b971-7a8b0ccfc0d5', '0cf03b2c-4e80-4f51-bd54-0392b7d36a43', 'fc8beab3-fe06-4a0e-a850-5353d967a84c', '42259714-b190-400f-b2d8-f612fa893345'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:03 devstack sudo[105837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:03 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-64fa2769-72a5-438e-8003-d73b4efa0ef2-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:03 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.272s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Deleted volume successfully.
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "cinder-64fa2769-72a5-438e-8003-d73b4efa0ef2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d8426645-2ebc-4e78-a179-ab3a2ac09d71 tempest-CinderUnicodeTest-229588734 None] Lock "cinder-25a5d425-36c1-4d5e-934b-0e495e2fe093-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Acquiring lock "cinder-quobyte-64fa2769-72a5-438e-8003-d73b4efa0ef2" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-64fa2769-72a5-438e-8003-d73b4efa0ef2" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef7c0b6-ebad-4280-9ec7-8132e49a5e51]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:03 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2
Sep 11 23:21:03 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:03 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2" returned: 0 in 0.419s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:03 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2
Sep 11 23:21:03 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:04 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-64fa2769-72a5-438e-8003-d73b4efa0ef2" returned: 0 in 0.257s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "cinder-quobyte-64fa2769-72a5-438e-8003-d73b4efa0ef2" released by "delete_volume" :: held 0.714s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Created reservations ['f609ca36-5db6-45fb-862b-be629b0ded2c', '9363f244-fe2e-4555-8c13-3859c3077b61', 'bf6b967e-225e-4ce8-8cbb-acd5405ae032', '7a9b6d2a-fe06-441d-afa2-7f7895770046'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:04 devstack sudo[105850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:04 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:04 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Deleted volume successfully.
Sep 11 23:21:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a77ec90e-5a7f-4093-a09d-06e5fd78fcda tempest-CinderUnicodeTest-229588734 None] Lock "cinder-64fa2769-72a5-438e-8003-d73b4efa0ef2-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=128,cinder:UPDATE=180,cinder:INSERT=43,cinder:DELETE=11 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=130,cinder:INSERT=51,cinder:UPDATE=182,cinder:DELETE=21 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Flow 'volume_create_manager' (415b2b44-479b-49af-b96e-d8d597275921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90e121-18e5-478c-aae9-d409a34d0f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e90e121-18e5-478c-aae9-d409a34d0f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035306387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7cf2ca-a394-47e3-86a2-f5b268289aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0808725271243379ab680d5bd6d442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:08Z,use_quota=True,user_id='d068de831913488a800684e0e2733989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06afa1fc-39dc-4724-8d40-2a0a08fdb63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06afa1fc-39dc-4724-8d40-2a0a08fdb63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96509923-1ec0-4f33-bc36-8280d8aff511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96509923-1ec0-4f33-bc36-8280d8aff511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7cf2ca-a394-47e3-86a2-f5b268289aca', 'volume_name': 'volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d644270-80f4-43ed-ba4f-dbd605ca309b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d644270-80f4-43ed-ba4f-dbd605ca309b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfeb5a0-dd00-4eef-9825-3985662a50bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Volume 3b7cf2ca-a394-47e3-86a2-f5b268289aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca', 'volume_size': 1}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1035306387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7cf2ca-a394-47e3-86a2-f5b268289aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0808725271243379ab680d5bd6d442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:08Z,use_quota=True,user_id='d068de831913488a800684e0e2733989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Creating volume 3b7cf2ca-a394-47e3-86a2-f5b268289aca {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:07 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca 1073741824
Sep 11 23:21:07 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:08 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca 1073741824" returned: 0 in 0.425s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:08 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca
Sep 11 23:21:08 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:08 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dfeb5a0-dd00-4eef-9825-3985662a50bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99c676e-e7ca-41ef-9960-93595f7cbea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Volume volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca (3b7cf2ca-a394-47e3-86a2-f5b268289aca): created successfully
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99c676e-e7ca-41ef-9960-93595f7cbea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Flow 'volume_create_manager' (415b2b44-479b-49af-b96e-d8d597275921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3c83df42-618a-4aa0-9043-f398f95ab5ea tempest-ProjectReaderTests-590059438 None] Created volume successfully.
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Acquiring lock "cinder-3b7cf2ca-a394-47e3-86a2-f5b268289aca-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "cinder-3b7cf2ca-a394-47e3-86a2-f5b268289aca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Acquiring lock "cinder-quobyte-3b7cf2ca-a394-47e3-86a2-f5b268289aca" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "cinder-quobyte-3b7cf2ca-a394-47e3-86a2-f5b268289aca" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a3655-97c6-401e-8a65-6cdb850e6e45]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:09 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca
Sep 11 23:21:09 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:09 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca" returned: 0 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:09 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca
Sep 11 23:21:09 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:09 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b7cf2ca-a394-47e3-86a2-f5b268289aca" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "cinder-quobyte-3b7cf2ca-a394-47e3-86a2-f5b268289aca" released by "delete_volume" :: held 0.659s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Created reservations ['5d620d06-f84f-44ba-a49f-3ea3d8f5b605', '0042c1ae-dff9-4422-bd4c-427d20f05f49', 'dbc4b7dc-ad66-41a1-9b2b-728e9a80d112', '23de1e54-ee6c-41b4-8546-143d05d6bb8a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:09 devstack sudo[105870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:09 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:09 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Deleted volume successfully.
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d7fe8fc8-0db0-4652-8b46-5beb9ac7e3af tempest-ProjectReaderTests-590059438 None] Lock "cinder-3b7cf2ca-a394-47e3-86a2-f5b268289aca-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Flow 'volume_create_manager' (9afe23ce-a6a6-4090-bd70-c9bed65d896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf2925-452a-4536-8302-1c7cf05ef1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52bf2925-452a-4536-8302-1c7cf05ef1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156517917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed93811-53c3-4b9e-b1ab-5d74f908f136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0808725271243379ab680d5bd6d442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:11Z,use_quota=True,user_id='d068de831913488a800684e0e2733989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d851958-6541-4d30-bc5c-5128f6dc9a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d851958-6541-4d30-bc5c-5128f6dc9a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0394294-1886-4e47-af09-837a7958aa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0394294-1886-4e47-af09-837a7958aa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed93811-53c3-4b9e-b1ab-5d74f908f136', 'volume_name': 'volume-bed93811-53c3-4b9e-b1ab-5d74f908f136', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec80987-63eb-4b1d-90ff-4faf2a059b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec80987-63eb-4b1d-90ff-4faf2a059b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29291a0-54e8-47a0-996a-8736a0d6a716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Volume bed93811-53c3-4b9e-b1ab-5d74f908f136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed93811-53c3-4b9e-b1ab-5d74f908f136', 'volume_size': 1}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156517917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed93811-53c3-4b9e-b1ab-5d74f908f136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0808725271243379ab680d5bd6d442a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:11Z,use_quota=True,user_id='d068de831913488a800684e0e2733989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Creating volume bed93811-53c3-4b9e-b1ab-5d74f908f136 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:10 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 1073741824
Sep 11 23:21:10 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:11 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 1073741824" returned: 0 in 0.410s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:11 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136
Sep 11 23:21:11 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:11 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136" returned: 0 in 0.235s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29291a0-54e8-47a0-996a-8736a0d6a716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed93811-53c3-4b9e-b1ab-5d74f908f136', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0e1728-41ed-4c22-983b-c78741f52fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Volume volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 (bed93811-53c3-4b9e-b1ab-5d74f908f136): created successfully
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0e1728-41ed-4c22-983b-c78741f52fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Flow 'volume_create_manager' (9afe23ce-a6a6-4090-bd70-c9bed65d896c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3ce3cf9d-b555-4b9c-af09-35a9c6af8a87 tempest-ProjectReaderTests-590059438 None] Created volume successfully.
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Acquiring lock "cinder-bed93811-53c3-4b9e-b1ab-5d74f908f136-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "cinder-bed93811-53c3-4b9e-b1ab-5d74f908f136-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Acquiring lock "cinder-quobyte-bed93811-53c3-4b9e-b1ab-5d74f908f136" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "cinder-quobyte-bed93811-53c3-4b9e-b1ab-5d74f908f136" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fdf24c-449b-4c7d-be1f-87be5826c8d9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:11 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136
Sep 11 23:21:11 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:12 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136" returned: 0 in 0.351s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:12 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136
Sep 11 23:21:12 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:12 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-bed93811-53c3-4b9e-b1ab-5d74f908f136" returned: 0 in 0.230s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "cinder-quobyte-bed93811-53c3-4b9e-b1ab-5d74f908f136" released by "delete_volume" :: held 0.615s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Created reservations ['60511fa1-2a5a-42e8-a10f-7e11f9be71fc', '48b02d10-aa82-4e9d-925a-2eb899c37aed', '9dbf1d8e-0ca8-4c82-bccf-6cafe4c0df23', '20c8c3f8-7ecb-4d87-be8e-bace5727de15'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:12 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:12 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:12 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.235s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Deleted volume successfully.
Sep 11 23:21:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-04f5436b-1560-404a-88c9-21c0b70dff8f tempest-ProjectReaderTests-590059438 None] Lock "cinder-bed93811-53c3-4b9e-b1ab-5d74f908f136-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (4a6beaec-5e60-48ad-8388-8105ae051229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cce60-1403-485b-aed5-8ab63f36de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2cce60-1403-485b-aed5-8ab63f36de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568147227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97a86af-4779-4ccb-ac63-7aade311e825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:16Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12511ee-934e-4239-90c0-3896f9ec8f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12511ee-934e-4239-90c0-3896f9ec8f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f6e16-f009-41a2-84bf-ba909e4f0648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467f6e16-f009-41a2-84bf-ba909e4f0648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a97a86af-4779-4ccb-ac63-7aade311e825', 'volume_name': 'volume-a97a86af-4779-4ccb-ac63-7aade311e825', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b36853f-4077-4a8b-91fb-af156359a1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b36853f-4077-4a8b-91fb-af156359a1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c262caec-7802-43b3-a8f8-3bd93bbff7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Volume a97a86af-4779-4ccb-ac63-7aade311e825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a97a86af-4779-4ccb-ac63-7aade311e825', 'volume_size': 1}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-568147227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a97a86af-4779-4ccb-ac63-7aade311e825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:16Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Creating volume a97a86af-4779-4ccb-ac63-7aade311e825 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:16 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:16 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 1073741824
Sep 11 23:21:16 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:16 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 1073741824" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:16 devstack sudo[105937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825
Sep 11 23:21:16 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:16 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] <== create_volume: return (655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c262caec-7802-43b3-a8f8-3bd93bbff7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a97a86af-4779-4ccb-ac63-7aade311e825', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12377a-7c1f-4e3f-b256-3afaae48b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Volume volume-a97a86af-4779-4ccb-ac63-7aade311e825 (a97a86af-4779-4ccb-ac63-7aade311e825): created successfully
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12377a-7c1f-4e3f-b256-3afaae48b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (4a6beaec-5e60-48ad-8388-8105ae051229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7c297970-36c1-4858-b6c5-bc69598c3c37 tempest-ProjectReaderTests-1335798787 None] Created volume successfully.
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-a97a86af-4779-4ccb-ac63-7aade311e825-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "cinder-a97a86af-4779-4ccb-ac63-7aade311e825-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-quobyte-a97a86af-4779-4ccb-ac63-7aade311e825" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-a97a86af-4779-4ccb-ac63-7aade311e825" acquired by "delete_volume" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[81546239-f3e5-4cf5-8d92-4e0d9d727939]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:17 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825
Sep 11 23:21:17 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:17 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:17 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825
Sep 11 23:21:17 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:18 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a97a86af-4779-4ccb-ac63-7aade311e825" returned: 0 in 0.243s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-a97a86af-4779-4ccb-ac63-7aade311e825" released by "delete_volume" :: held 0.637s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Created reservations ['eb7c6e09-b61e-49bd-bb95-faf496e895bf', '68f6cbe9-0df5-4f73-886a-6d7f41c65aaf', '92910955-5029-4b36-ac31-9178ba1bcd8a', 'f7bbcd2b-58f4-4d81-8c24-de8031fbc492'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:18 devstack sudo[105948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:18 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:18 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.237s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Deleted volume successfully.
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d40a71d9-b5c2-430b-8770-87b5306395ef tempest-ProjectReaderTests-1335798787 None] Lock "cinder-a97a86af-4779-4ccb-ac63-7aade311e825-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (0b500c49-e598-42fd-9d09-c0d42949a859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf9df91-94c1-463b-9634-72f471d50bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf9df91-94c1-463b-9634-72f471d50bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320707844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1269b100-3fd5-4322-9aae-d6a2952b7acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:19Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96362fb6-bb9d-4060-bc43-49e4e8b33b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96362fb6-bb9d-4060-bc43-49e4e8b33b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ec291c-fefc-4fd4-a368-643b6a484c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ec291c-fefc-4fd4-a368-643b6a484c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1269b100-3fd5-4322-9aae-d6a2952b7acf', 'volume_name': 'volume-1269b100-3fd5-4322-9aae-d6a2952b7acf', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1547df9-263e-4a33-ba90-7943c3123e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1547df9-263e-4a33-ba90-7943c3123e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33f744d-0090-4b24-ae87-90c69b301ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Volume 1269b100-3fd5-4322-9aae-d6a2952b7acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1269b100-3fd5-4322-9aae-d6a2952b7acf', 'volume_size': 1}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320707844',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1269b100-3fd5-4322-9aae-d6a2952b7acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:19Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Creating volume 1269b100-3fd5-4322-9aae-d6a2952b7acf {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:19 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:19 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf 1073741824
Sep 11 23:21:19 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:19 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf 1073741824" returned: 0 in 0.388s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:19 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf
Sep 11 23:21:19 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:19 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33f744d-0090-4b24-ae87-90c69b301ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1269b100-3fd5-4322-9aae-d6a2952b7acf', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467e7d93-1487-48da-8a27-2a78a0bf3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Volume volume-1269b100-3fd5-4322-9aae-d6a2952b7acf (1269b100-3fd5-4322-9aae-d6a2952b7acf): created successfully
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467e7d93-1487-48da-8a27-2a78a0bf3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (0b500c49-e598-42fd-9d09-c0d42949a859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2b22f067-cf6f-42f1-96ca-809e94e3361a tempest-ProjectReaderTests-1335798787 None] Created volume successfully.
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-1269b100-3fd5-4322-9aae-d6a2952b7acf-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-1269b100-3fd5-4322-9aae-d6a2952b7acf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-quobyte-1269b100-3fd5-4322-9aae-d6a2952b7acf" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-1269b100-3fd5-4322-9aae-d6a2952b7acf" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f762330-c099-4f6f-881b-e2474fd6f63b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:20 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf
Sep 11 23:21:20 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:20 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf" returned: 0 in 0.349s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:20 devstack sudo[105964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf
Sep 11 23:21:20 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:20 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1269b100-3fd5-4322-9aae-d6a2952b7acf" returned: 0 in 0.229s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-1269b100-3fd5-4322-9aae-d6a2952b7acf" released by "delete_volume" :: held 0.613s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Created reservations ['f9e9868d-8127-44f8-81aa-63ca10157c1d', '07e3d2b5-6642-4d42-97d2-f43b0c2ccb26', '5a6abe6d-6465-4325-92bc-9dfc2a831215', '9ef4a087-1ac5-4ed3-8028-388416e1e989'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:20 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:20 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:21 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.257s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Deleted volume successfully.
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-82e18580-b3fe-4580-b1d1-f72bf0291136 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-1269b100-3fd5-4322-9aae-d6a2952b7acf-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (93be54f2-0778-4456-8113-95860cb418bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce747e3-262f-4b15-a4f7-595e11e46809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce747e3-262f-4b15-a4f7-595e11e46809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007869150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a49c31-70c6-4438-a6e5-d100c74494d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:22Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4703c2b1-653e-4a5b-afaa-89f7351d5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4703c2b1-653e-4a5b-afaa-89f7351d5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fc9d44-6616-42e3-9094-5615a84cda5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fc9d44-6616-42e3-9094-5615a84cda5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a49c31-70c6-4438-a6e5-d100c74494d4', 'volume_name': 'volume-74a49c31-70c6-4438-a6e5-d100c74494d4', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da05021f-216c-4af3-bf7e-a858c73bb9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da05021f-216c-4af3-bf7e-a858c73bb9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc54275-898e-45d5-a277-7e7ae98318ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:21 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Volume 74a49c31-70c6-4438-a6e5-d100c74494d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a49c31-70c6-4438-a6e5-d100c74494d4', 'volume_size': 1}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1007869150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a49c31-70c6-4438-a6e5-d100c74494d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:22Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Creating volume 74a49c31-70c6-4438-a6e5-d100c74494d4 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:21 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:21 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 1073741824
Sep 11 23:21:21 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:22 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 1073741824" returned: 0 in 0.380s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:22 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4
Sep 11 23:21:22 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:22 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] <== create_volume: return (649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.652s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddc54275-898e-45d5-a277-7e7ae98318ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a49c31-70c6-4438-a6e5-d100c74494d4', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28726441-47ea-47fd-a259-8dcc5eb6ebd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Volume volume-74a49c31-70c6-4438-a6e5-d100c74494d4 (74a49c31-70c6-4438-a6e5-d100c74494d4): created successfully
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28726441-47ea-47fd-a259-8dcc5eb6ebd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (93be54f2-0778-4456-8113-95860cb418bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-aded2250-8b53-422e-bedb-9b35bf48b6da tempest-ProjectReaderTests-1335798787 None] Created volume successfully.
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-74a49c31-70c6-4438-a6e5-d100c74494d4-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-74a49c31-70c6-4438-a6e5-d100c74494d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-quobyte-74a49c31-70c6-4438-a6e5-d100c74494d4" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-74a49c31-70c6-4438-a6e5-d100c74494d4" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ebdccb-866a-4a17-89ea-5798a868e1ec]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:22 devstack sudo[105978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4
Sep 11 23:21:22 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:23 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:23 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4
Sep 11 23:21:23 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:23 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-74a49c31-70c6-4438-a6e5-d100c74494d4" returned: 0 in 0.233s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-74a49c31-70c6-4438-a6e5-d100c74494d4" released by "delete_volume" :: held 0.617s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Created reservations ['618b56bf-3f51-4e9c-8444-bf5a0aa1119c', '77ef7423-2f4c-48aa-bb41-799d30db53d8', '8f1d71a0-961d-4a2a-a6a9-26dc28031b4b', '993c873e-a399-4955-8974-ebccbb8dda13'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:23 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:23 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:23 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.225s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Deleted volume successfully.
Sep 11 23:21:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2f69c41d-75e9-4183-8ecf-f25ab93942f5 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-74a49c31-70c6-4438-a6e5-d100c74494d4-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (c7d08638-ecfc-4161-a0af-54da658e2708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f0e828-dc16-4fbf-9099-f0610b691027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f0e828-dc16-4fbf-9099-f0610b691027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343474607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829273b2-0f6e-4b14-8163-24103d5e0473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:24Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a288154-baaf-41e1-9284-47caa715c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a288154-baaf-41e1-9284-47caa715c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd2b144-2ce6-40d5-a21a-d78a12d91521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd2b144-2ce6-40d5-a21a-d78a12d91521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829273b2-0f6e-4b14-8163-24103d5e0473', 'volume_name': 'volume-829273b2-0f6e-4b14-8163-24103d5e0473', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b25dd1d-7359-4d39-bddb-32a35efff57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b25dd1d-7359-4d39-bddb-32a35efff57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a8952c-64d0-4a24-ac4e-cb32c8bdc193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:24 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Volume 829273b2-0f6e-4b14-8163-24103d5e0473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829273b2-0f6e-4b14-8163-24103d5e0473', 'volume_size': 1}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343474607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829273b2-0f6e-4b14-8163-24103d5e0473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fafe8cf26b13491f87e464818724c339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:24Z,use_quota=True,user_id='5fdc711bc56146f0a27670b57aaf6767',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Creating volume 829273b2-0f6e-4b14-8163-24103d5e0473 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:24 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:24 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 1073741824
Sep 11 23:21:24 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:24 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 1073741824" returned: 0 in 0.400s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:24 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473
Sep 11 23:21:24 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:25 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473" returned: 0 in 0.234s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a8952c-64d0-4a24-ac4e-cb32c8bdc193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829273b2-0f6e-4b14-8163-24103d5e0473', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf0df0-ccd7-40e5-8862-ff89442cf273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Volume volume-829273b2-0f6e-4b14-8163-24103d5e0473 (829273b2-0f6e-4b14-8163-24103d5e0473): created successfully
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf0df0-ccd7-40e5-8862-ff89442cf273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Flow 'volume_create_manager' (c7d08638-ecfc-4161-a0af-54da658e2708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10318815-019f-4016-9f6e-65b3036e9216 tempest-ProjectReaderTests-1335798787 None] Created volume successfully.
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-829273b2-0f6e-4b14-8163-24103d5e0473-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-829273b2-0f6e-4b14-8163-24103d5e0473-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "cinder-quobyte-829273b2-0f6e-4b14-8163-24103d5e0473" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-829273b2-0f6e-4b14-8163-24103d5e0473" acquired by "delete_volume" :: waited 0.012s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e532b805-aa29-4566-bd85-6ec7ff38697b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:25 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473
Sep 11 23:21:25 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:25 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473" returned: 0 in 0.342s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:25 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473
Sep 11 23:21:25 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:25 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-829273b2-0f6e-4b14-8163-24103d5e0473" returned: 0 in 0.231s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-quobyte-829273b2-0f6e-4b14-8163-24103d5e0473" released by "delete_volume" :: held 0.610s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Created reservations ['c9f197db-e31c-4684-a525-2a6310e2e713', '9cd8d020-7249-451c-856c-db17216031bb', 'f3e74f65-ec9c-4246-b124-5a56cc8f6cfb', 'be0c90b2-c99a-4e72-b61d-ea2c99d7caa9'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:26 devstack sudo[106012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:26 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:26 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.232s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Deleted volume successfully.
Sep 11 23:21:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1357b3fe-0bb2-4fcd-82cf-241892331b41 tempest-ProjectReaderTests-1335798787 None] Lock "cinder-829273b2-0f6e-4b14-8163-24103d5e0473-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=41,cinder:UPDATE=71,cinder:INSERT=19,cinder:DELETE=7 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:21:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=42,cinder:UPDATE=60,cinder:INSERT=11,cinder:DELETE=5 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Flow 'volume_create_manager' (b65f85c0-3911-44ac-96f8-b59542135a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dfc6e8-045b-4d77-a20a-550095ae0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4dfc6e8-045b-4d77-a20a-550095ae0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-694619716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621b1cee-9048-4206-807d-e0e94ef0dd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9c9c72e35e4864b62324820f184311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='9582344a50b6467aa01b69254b65b7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2536cc-0e41-4b86-aa30-780426d660f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2536cc-0e41-4b86-aa30-780426d660f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772238eb-1bdd-4fff-9611-504aa9674b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772238eb-1bdd-4fff-9611-504aa9674b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621b1cee-9048-4206-807d-e0e94ef0dd4b', 'volume_name': 'volume-621b1cee-9048-4206-807d-e0e94ef0dd4b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f44882-0f01-4b72-bf15-5933508692d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f44882-0f01-4b72-bf15-5933508692d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f92819-fa6e-4274-9bff-f3bcf4d30426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Volume 621b1cee-9048-4206-807d-e0e94ef0dd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621b1cee-9048-4206-807d-e0e94ef0dd4b', 'volume_size': 1}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-694619716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621b1cee-9048-4206-807d-e0e94ef0dd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9c9c72e35e4864b62324820f184311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='9582344a50b6467aa01b69254b65b7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Creating volume 621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:38 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:38 devstack sudo[106056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b 1073741824
Sep 11 23:21:38 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (24439f8b-85d9-4027-955e-945ef758896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97391e-3ec7-4911-9a24-a9ed3718ff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (94b586a1-8574-4cd6-9429-7afa47ae51d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a985cdb4-62b2-4a77-9830-b306638651ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df97391e-3ec7-4911-9a24-a9ed3718ff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1049469455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c34b2c8-1577-4322-bd74-62e3ff84d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b85dabf-5057-423d-86f1-d79b4fccba8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b85dabf-5057-423d-86f1-d79b4fccba8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a52980-408a-4238-8997-7994e4e8ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a52980-408a-4238-8997-7994e4e8ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c34b2c8-1577-4322-bd74-62e3ff84d792', 'volume_name': 'volume-0c34b2c8-1577-4322-bd74-62e3ff84d792', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f589a099-bfc9-4d8a-9d83-303d2a2babd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f589a099-bfc9-4d8a-9d83-303d2a2babd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b8ad50-4784-4921-8442-8612aac24d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Volume 0c34b2c8-1577-4322-bd74-62e3ff84d792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c34b2c8-1577-4322-bd74-62e3ff84d792', 'volume_size': 1}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a985cdb4-62b2-4a77-9830-b306638651ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089048201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78ff689-6cc5-4c03-adcb-00ab9605424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd47d829-7767-4155-9976-01f209739d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd47d829-7767-4155-9976-01f209739d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007adc3a-1ac9-4f7c-97b6-e02f142c80ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007adc3a-1ac9-4f7c-97b6-e02f142c80ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78ff689-6cc5-4c03-adcb-00ab9605424e', 'volume_name': 'volume-d78ff689-6cc5-4c03-adcb-00ab9605424e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41ddf84-1722-4f32-a656-e8be60fd2935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41ddf84-1722-4f32-a656-e8be60fd2935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda462fa-e9b6-4714-866e-f1ee67d642c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Volume d78ff689-6cc5-4c03-adcb-00ab9605424e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78ff689-6cc5-4c03-adcb-00ab9605424e', 'volume_size': 1}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (9821b458-3157-41fa-9bc2-0ef7967848fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338fe523-5a80-479b-8a88-031a62dc4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338fe523-5a80-479b-8a88-031a62dc4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589716786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851858c4-0982-4d39-b657-04e9ed1e3348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667ab2ff-fec2-414a-913e-4dfc4911c01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667ab2ff-fec2-414a-913e-4dfc4911c01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ce333e-014a-49d6-8bab-2b45c654b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ce333e-014a-49d6-8bab-2b45c654b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '851858c4-0982-4d39-b657-04e9ed1e3348', 'volume_name': 'volume-851858c4-0982-4d39-b657-04e9ed1e3348', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327aa637-7be4-4788-85c0-cf7611c68386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (327aa637-7be4-4788-85c0-cf7611c68386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c7eeed-0eb0-4f3d-8222-b0d51f120253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Volume 851858c4-0982-4d39-b657-04e9ed1e3348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-851858c4-0982-4d39-b657-04e9ed1e3348', 'volume_size': 1}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:39 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b 1073741824" returned: 0 in 0.819s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:39 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:21:39 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (178b8b35-a129-4a9b-ac11-1498f10e1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780b215d-d188-4045-bde3-72688778ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780b215d-d188-4045-bde3-72688778ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-921236427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46746c54-9196-4483-8722-0df0e161cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46746c54-9196-4483-8722-0df0e161cf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc86c4-2e7c-4e49-972d-ce36b79ca96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc86c4-2e7c-4e49-972d-ce36b79ca96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5', 'volume_name': 'volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170bd2ad-bc95-458e-954b-1346d241259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170bd2ad-bc95-458e-954b-1346d241259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9b8045-f634-4853-8eb6-8d2b2356a50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Volume 2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5', 'volume_size': 1}
Sep 11 23:21:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:40 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1049469455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c34b2c8-1577-4322-bd74-62e3ff84d792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Creating volume 0c34b2c8-1577-4322-bd74-62e3ff84d792 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:40 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:40 devstack sudo[106066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 1073741824
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f92819-fa6e-4274-9bff-f3bcf4d30426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621b1cee-9048-4206-807d-e0e94ef0dd4b', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20b0d20-05b7-4ea2-b6f2-7623299d0f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (95b6d574-0f6d-4b7c-aa7c-a823954d4111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df71268-4a87-49a6-96d5-9c9185e926ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Volume volume-621b1cee-9048-4206-807d-e0e94ef0dd4b (621b1cee-9048-4206-807d-e0e94ef0dd4b): created successfully
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20b0d20-05b7-4ea2-b6f2-7623299d0f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Flow 'volume_create_manager' (b65f85c0-3911-44ac-96f8-b59542135a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df71268-4a87-49a6-96d5-9c9185e926ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878300985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379421d-c4d4-41c1-9a17-a17abdf26728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0543fcf7-7516-4e98-8d0f-4d3b33eeb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0543fcf7-7516-4e98-8d0f-4d3b33eeb013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ce60be-0e00-4c16-9e82-c9301b42f8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ce60be-0e00-4c16-9e82-c9301b42f8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a379421d-c4d4-41c1-9a17-a17abdf26728', 'volume_name': 'volume-a379421d-c4d4-41c1-9a17-a17abdf26728', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32b960-1acc-467e-88e2-1b77ceb3640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be32b960-1acc-467e-88e2-1b77ceb3640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1c0796-a946-45e1-bd14-9ab3261dfa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Volume a379421d-c4d4-41c1-9a17-a17abdf26728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a379421d-c4d4-41c1-9a17-a17abdf26728', 'volume_size': 1}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d519b418-947d-4792-ab0c-adf6744b175f tempest-VolumeDependencyTests-1505810515 None] Created volume successfully.
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (d993be33-70f2-450a-9792-2ad70e1ac059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f4d7e-a311-40a4-8294-b8366b09dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad9f4d7e-a311-40a4-8294-b8366b09dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523391691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766c44cb-8242-44eb-8f46-249607c81e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d813b62-193c-4199-9435-cf1765df7978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d813b62-193c-4199-9435-cf1765df7978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353cd01a-6a9d-4cfd-9dc7-badf793d1094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353cd01a-6a9d-4cfd-9dc7-badf793d1094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766c44cb-8242-44eb-8f46-249607c81e4a', 'volume_name': 'volume-766c44cb-8242-44eb-8f46-249607c81e4a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b0c648-0a02-4894-9c18-0d48382f55f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3b0c648-0a02-4894-9c18-0d48382f55f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17898ba0-395c-4862-b404-fc8632e1eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Volume 766c44cb-8242-44eb-8f46-249607c81e4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766c44cb-8242-44eb-8f46-249607c81e4a', 'volume_size': 1}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:40 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 1073741824" returned: 0 in 0.589s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:40 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792
Sep 11 23:21:40 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:41 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792" returned: 0 in 0.289s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089048201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78ff689-6cc5-4c03-adcb-00ab9605424e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Creating volume d78ff689-6cc5-4c03-adcb-00ab9605424e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:41 devstack sudo[106075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e 1073741824
Sep 11 23:21:41 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b8ad50-4784-4921-8442-8612aac24d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c34b2c8-1577-4322-bd74-62e3ff84d792', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411057f-517c-479c-9817-268f549c8a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Volume volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 (0c34b2c8-1577-4322-bd74-62e3ff84d792): created successfully
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2411057f-517c-479c-9817-268f549c8a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (24439f8b-85d9-4027-955e-945ef758896e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f936deb5-2276-4580-ba8d-0f8c10374089 tempest-CreateVolumesFromImageTest-929040804 None] Created volume successfully.
Sep 11 23:21:41 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e 1073741824" returned: 0 in 0.482s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:41 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e
Sep 11 23:21:41 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:41 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.404s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-589716786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=851858c4-0982-4d39-b657-04e9ed1e3348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:39Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Creating volume 851858c4-0982-4d39-b657-04e9ed1e3348 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda462fa-e9b6-4714-866e-f1ee67d642c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78ff689-6cc5-4c03-adcb-00ab9605424e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:41 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 1073741824
Sep 11 23:21:41 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f1119c-4908-494e-b025-4231a158a845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Volume volume-d78ff689-6cc5-4c03-adcb-00ab9605424e (d78ff689-6cc5-4c03-adcb-00ab9605424e): created successfully
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f1119c-4908-494e-b025-4231a158a845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (94b586a1-8574-4cd6-9429-7afa47ae51d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a14e8994-9149-46a0-95b2-4da96775af9b tempest-CreateVolumesFromImageTest-929040804 None] Created volume successfully.
Sep 11 23:21:42 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 1073741824" returned: 0 in 0.482s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:42 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348
Sep 11 23:21:42 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:42 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.709s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-921236427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Creating volume 2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:42 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:42 devstack sudo[106095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 1073741824
Sep 11 23:21:42 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c7eeed-0eb0-4f3d-8222-b0d51f120253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-851858c4-0982-4d39-b657-04e9ed1e3348', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5911e-a8e1-4364-a156-79012d5eee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:42 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Volume volume-851858c4-0982-4d39-b657-04e9ed1e3348 (851858c4-0982-4d39-b657-04e9ed1e3348): created successfully
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec5911e-a8e1-4364-a156-79012d5eee31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (9821b458-3157-41fa-9bc2-0ef7967848fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:42 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d374e883-b0ed-47a4-9b58-dd3682a25cc4 tempest-CreateVolumesFromImageTest-929040804 None] Created volume successfully.
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Flow 'volume_create_manager' (00e945e8-3ef2-4a5c-8bd1-2417b1000a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84f78b-c428-4204-99b8-a57badbb72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:42 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f84f78b-c428-4204-99b8-a57badbb72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b337c9df-23cf-40d1-8235-da203c1cd7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6bb64d519645a0b0f142990169189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:43Z,use_quota=True,user_id='b598be7a5a164033b2e658166b8c44b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f118b85-0e20-40f3-8c99-ec56a38f48d6),volume_type_id=8f118b85-0e20-40f3-8c99-ec56a38f48d6)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373f0c7a-af88-438b-96ad-904b376c943d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373f0c7a-af88-438b-96ad-904b376c943d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26786f1f-4794-42ba-a008-fb2d8b177e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:21:43 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 1073741824" returned: 0 in 0.520s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:43 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5
Sep 11 23:21:43 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26786f1f-4794-42ba-a008-fb2d8b177e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b337c9df-23cf-40d1-8235-da203c1cd7f7', 'volume_name': 'volume-b337c9df-23cf-40d1-8235-da203c1cd7f7', 'volume_size': 1, 'image_id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbf2cd7bdaa19e79c092bb49e310bad1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd6bb64d519645a0b0f142990169189b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e7241327d62ab64e4bf13110f80535260724ac266a7d97108e45bc74c6b6a31dc789b5a57b8d2c95ad8bb891bff29771af555601a411d1dd31d61b4efa6f58b', 'id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'created_at': datetime.datetime(2026, 9, 11, 21, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da3b8763-8779-4977-b06e-6672830aabe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e4950>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9992c1-9979-4fcd-aa4f-f84d986f19b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9992c1-9979-4fcd-aa4f-f84d986f19b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6126b3-9f6d-477a-85ea-7f815f95d178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Volume b337c9df-23cf-40d1-8235-da203c1cd7f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b337c9df-23cf-40d1-8235-da203c1cd7f7', 'volume_size': 1, 'image_id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbf2cd7bdaa19e79c092bb49e310bad1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd6bb64d519645a0b0f142990169189b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e7241327d62ab64e4bf13110f80535260724ac266a7d97108e45bc74c6b6a31dc789b5a57b8d2c95ad8bb891bff29771af555601a411d1dd31d61b4efa6f58b', 'id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'created_at': datetime.datetime(2026, 9, 11, 21, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da3b8763-8779-4977-b06e-6672830aabe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e4950>}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Trying to clone b337c9df-23cf-40d1-8235-da203c1cd7f7 from image da3b8763-8779-4977-b06e-6672830aabe2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:21:43 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 23:21:43 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.103s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1878300985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379421d-c4d4-41c1-9a17-a17abdf26728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Creating volume a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:43 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9b8045-f634-4853-8eb6-8d2b2356a50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack sudo[106104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 1073741824
Sep 11 23:21:43 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5071e2c5-a3f0-47ef-8c49-d860c3410f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25226b0-493e-46d0-ae62-218e2bda931e]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:43 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Volume volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 (2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5): created successfully
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5071e2c5-a3f0-47ef-8c49-d860c3410f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (178b8b35-a129-4a9b-ac11-1498f10e1301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9e0ace60-2e4b-47b7-a1f9-bc3085fc5fdb tempest-CreateVolumesFromImageTest-929040804 None] Created volume successfully.
Sep 11 23:21:43 devstack sudo[106106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:43 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:43 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:43 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 1073741824" returned: 0 in 0.441s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:43 devstack sudo[106114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728
Sep 11 23:21:44 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:44 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:44 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:44 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.764s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-523391691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=766c44cb-8242-44eb-8f46-249607c81e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32852556d42e4f8aba6a42fa5bad685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:40Z,use_quota=True,user_id='902d7d7d821c4a10ab4011816a9d9638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Creating volume 766c44cb-8242-44eb-8f46-249607c81e4a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:44 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:44 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Temporary image da3b8763-8779-4977-b06e-6672830aabe2 is fetched for user b598be7a5a164033b2e658166b8c44b7. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:21:44 devstack sudo[106121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a 1073741824
Sep 11 23:21:44 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1c0796-a946-45e1-bd14-9ab3261dfa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a379421d-c4d4-41c1-9a17-a17abdf26728', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9830d9eb-fbb5-44e8-9853-3a895aebf495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:44 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Volume volume-a379421d-c4d4-41c1-9a17-a17abdf26728 (a379421d-c4d4-41c1-9a17-a17abdf26728): created successfully
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9830d9eb-fbb5-44e8-9853-3a895aebf495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (95b6d574-0f6d-4b7c-aa7c-a823954d4111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:44 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d4441440-8639-4be4-8d21-675b62f6e14f tempest-ProjectReaderTests-362718808 None] Created volume successfully.
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e975fd-5c4c-4985-a56b-3d8f647b6ef2]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:44 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:44 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:44 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:44 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a 1073741824" returned: 0 in 0.490s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:44 devstack sudo[106132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a
Sep 11 23:21:44 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:44 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:44 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:45 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.948s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17898ba0-395c-4862-b404-fc8632e1eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766c44cb-8242-44eb-8f46-249607c81e4a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa44fe4-35a1-43a5-b308-b511a2962559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Creating offline snapshot 741c3dd2-1ed7-4f90-979c-8711fa108b25 of volume 621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:21:45 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:45 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Volume volume-766c44cb-8242-44eb-8f46-249607c81e4a (766c44cb-8242-44eb-8f46-249607c81e4a): created successfully
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa44fe4-35a1-43a5-b308-b511a2962559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Flow 'volume_create_manager' (d993be33-70f2-450a-9792-2ad70e1ac059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd4d78-223c-46bf-8bdd-1f7158e56be2]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-23a083e1-688c-4ca2-b2a1-3c79abf2ec20 tempest-CreateVolumesFromImageTest-929040804 None] Created volume successfully.
Sep 11 23:21:45 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:21:45 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:45 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:45 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 1G
Sep 11 23:21:45 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-766c44cb-8242-44eb-8f46-249607c81e4a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-766c44cb-8242-44eb-8f46-249607c81e4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-quobyte-766c44cb-8242-44eb-8f46-249607c81e4a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-766c44cb-8242-44eb-8f46-249607c81e4a" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[802f164a-05a8-439e-ae8d-56ca32d1c2de]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 1G" returned: 0 in 0.482s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621b1cee-9048-4206-807d-e0e94ef0dd4b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621b1cee-9048-4206-807d-e0e94ef0dd4b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:21:46 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a
Sep 11 23:21:46 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:46 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.292s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:46 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:21:46 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-621b1cee-9048-4206-807d-e0e94ef0dd4b -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.341s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 is being set with open permissions: ugo+rw
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:21:46 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-766c44cb-8242-44eb-8f46-249607c81e4a" returned: 0 in 0.282s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-766c44cb-8242-44eb-8f46-249607c81e4a" released by "delete_volume" :: held 0.713s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:46 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.268s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Created reservations ['47197449-9b0e-46e2-ab2c-22190784cc7f', '2f162b53-19ce-4b1b-8151-424f1a151e71', '3dc5fcc3-56fc-43df-b19b-39b2f663c5ee', '1212e9d7-5b4d-441c-b374-d98457d9933c'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:46 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info
Sep 11 23:21:46 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:46 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:46 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:46 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info" returned: 0 in 0.273s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:46 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info is being set with open permissions: ugo+rw
Sep 11 23:21:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info
Sep 11 23:21:47 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:47 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Deleted volume successfully.
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-quobyte-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9b88212c-425a-4632-939b-a56caec1b7c2 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-766c44cb-8242-44eb-8f46-249607c81e4a-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c08f1d2-2922-4281-85be-aef5b90afc78]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.info" returned: 0 in 0.293s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.187s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b337c9df-23cf-40d1-8235-da203c1cd7f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd6bb64d519645a0b0f142990169189b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:43Z,use_quota=True,user_id='b598be7a5a164033b2e658166b8c44b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f118b85-0e20-40f3-8c99-ec56a38f48d6),volume_type_id=8f118b85-0e20-40f3-8c99-ec56a38f48d6)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:47 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Creating volume b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:47 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:47 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1073741824
Sep 11 23:21:47 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c192a38f-a7a9-44d1-8b18-9df3e1accb88 tempest-VolumeDependencyTests-1505810515 None] Create snapshot completed successfully
Sep 11 23:21:47 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5
Sep 11 23:21:47 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:47 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1073741824" returned: 0 in 0.448s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:47 devstack sudo[106193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7
Sep 11 23:21:47 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5" released by "delete_volume" :: held 0.687s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Created reservations ['a0fb79dd-6782-489b-acc9-7f20f7d774b6', 'adb0db60-6e1c-4b70-bd7a-76564f94b2c9', '8848b057-978c-4ee5-bd16-55991a3c8986', 'eca26ff1-aa8d-49b6-b531-81acd98ff670'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:47 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:47 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:48 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7" returned: 0 in 0.293s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.691s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Creating offline snapshot 769b3ecb-dfce-48b2-bb31-9d5720ef6964 of volume a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Attempting download of da3b8763-8779-4977-b06e-6672830aabe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}])) to volume b337c9df-23cf-40d1-8235-da203c1cd7f7. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca54e4d9-8cc6-4c3e-a4ce-dbe70260faf9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[12794bd5-dc68-4242-96bc-9989b34b3c19]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:48 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Deleted volume successfully.
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a5240861-f073-43c3-afb3-dcab94ff4744 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-2c3b0352-4b0f-4aba-a8c6-45c874c1e4e5-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:48 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728
Sep 11 23:21:48 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-851858c4-0982-4d39-b657-04e9ed1e3348-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-851858c4-0982-4d39-b657-04e9ed1e3348-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-quobyte-851858c4-0982-4d39-b657-04e9ed1e3348" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-851858c4-0982-4d39-b657-04e9ed1e3348" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:48 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6
Sep 11 23:21:48 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f950402d-baac-460d-85ea-ab6c66b43e1d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:48 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348
Sep 11 23:21:48 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:48 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:48 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728" returned: 0 in 0.576s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:48 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 1G
Sep 11 23:21:48 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:48 devstack sudo[106210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6
Sep 11 23:21:48 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348" returned: 0 in 0.537s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348
Sep 11 23:21:49 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Flow 'volume_create_manager' (2fb9f8be-a899-4f1e-99e6-5b75c4e76440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:49 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d1ba75-7f12-435b-b34e-bb63e6ca24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6" returned: 1 in 0.436s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_da3b8763-8779-4977-b06e-6672830aabe2_rokq4ct6' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8ef03-2248-4c04-bc1d-d5abbdb9a70b]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d1ba75-7f12-435b-b34e-bb63e6ca24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-333262771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ed07ab-bbcf-4554-8ef1-8638d41d0097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9c9c72e35e4864b62324820f184311',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=741c3dd2-1ed7-4f90-979c-8711fa108b25,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:21:49Z,use_quota=True,user_id='9582344a50b6467aa01b69254b65b7ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71717797-4444-496e-a374-43cdf2ff2fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71717797-4444-496e-a374-43cdf2ff2fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb50e64-d44b-4e34-b6da-d87019a33600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bb50e64-d44b-4e34-b6da-d87019a33600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91ed07ab-bbcf-4554-8ef1-8638d41d0097', 'volume_name': 'volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097', 'volume_size': 1, 'snapshot_id': '741c3dd2-1ed7-4f90-979c-8711fa108b25'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f15b01-85ac-4b98-8ab0-9654491456d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f15b01-85ac-4b98-8ab0-9654491456d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94b5c15-c356-4e4e-b23c-9d2ea3013e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:49 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Volume 91ed07ab-bbcf-4554-8ef1-8638d41d0097: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097', 'volume_size': 1, 'snapshot_id': '741c3dd2-1ed7-4f90-979c-8711fa108b25'}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:49 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:49 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 1G" returned: 0 in 0.570s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a379421d-c4d4-41c1-9a17-a17abdf26728 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a379421d-c4d4-41c1-9a17-a17abdf26728 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964
Sep 11 23:21:49 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-851858c4-0982-4d39-b657-04e9ed1e3348" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-851858c4-0982-4d39-b657-04e9ed1e3348" released by "delete_volume" :: held 0.930s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Created reservations ['a6ed094c-cfb2-49c2-8ce2-01ceba2564f5', '14a32cd5-8c0c-41e5-b3fd-5d163d22b0e7', '18c2242d-4529-477e-900f-d87e841f639d', '41e1c5db-1f6f-42ef-96aa-527be618465c'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:49 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-d78ff689-6cc5-4c03-adcb-00ab9605424e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-d78ff689-6cc5-4c03-adcb-00ab9605424e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-quobyte-d78ff689-6cc5-4c03-adcb-00ab9605424e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-d78ff689-6cc5-4c03-adcb-00ab9605424e" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:49 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD
Sep 11 23:21:49 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d6321-4f7d-40ee-9d54-f35db94722aa]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a379421d-c4d4-41c1-9a17-a17abdf26728 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964" returned: 0 in 0.459s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 is being set with open permissions: ugo+rw
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:49 devstack sudo[106242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964
Sep 11 23:21:49 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Deleted volume successfully.
Sep 11 23:21:49 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e
Sep 11 23:21:49 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ed2fc910-e134-4091-9085-114ec9ec0725 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-851858c4-0982-4d39-b657-04e9ed1e3348-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:49 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD" returned: 1 in 0.424s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] da3b8763-8779-4977-b06e-6672830aabe2 was raw, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:21:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7
Sep 11 23:21:50 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964" returned: 0 in 0.345s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e" returned: 0 in 0.404s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info
Sep 11 23:21:50 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e
Sep 11 23:21:50 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info is being set with open permissions: ugo+rw
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info
Sep 11 23:21:50 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d78ff689-6cc5-4c03-adcb-00ab9605424e" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-d78ff689-6cc5-4c03-adcb-00ab9605424e" released by "delete_volume" :: held 0.762s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Created reservations ['96e0d31c-4ed7-4951-9f71-f69d1ac51a5d', '3a083dc8-a40a-4288-8e6d-fb1e6d983eab', '82a97524-8b3b-49b9-be31-cb074ce89084', '79eb3faf-6ed0-4434-8338-63d25ba499ae'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7" returned: 0 in 0.562s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_da3b8763-8779-4977-b06e-6672830aabe2_kalhwajcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:21:50 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1G
Sep 11 23:21:50 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:50 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:50 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.info" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.487s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25-91ed07ab-bbcf-4554-8ef1-8638d41d0097" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25-91ed07ab-bbcf-4554-8ef1-8638d41d0097" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Creating volume 91ed07ab-bbcf-4554-8ef1-8638d41d0097 from snapshot 741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2322ba1d-e1bf-4edd-a6cf-1cc9f5592973 tempest-ProjectReaderTests-362718808 None] Create snapshot completed successfully
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] snapshot: 741c3dd2-1ed7-4f90-979c-8711fa108b25, volume: 91ed07ab-bbcf-4554-8ef1-8638d41d0097,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-0c34b2c8-1577-4322-bd74-62e3ff84d792-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-0c34b2c8-1577-4322-bd74-62e3ff84d792-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56d3dab-28cc-4b88-b4b9-d63e07ea9f76]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "cinder-quobyte-0c34b2c8-1577-4322-bd74-62e3ff84d792" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-0c34b2c8-1577-4322-bd74-62e3ff84d792" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:50 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0078bf-96cc-480a-81fd-e128f8a7a601]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:50 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.380s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 1G" returned: 0 in 0.479s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Downloaded image da3b8763-8779-4977-b06e-6672830aabe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}])) to volume b337c9df-23cf-40d1-8235-da203c1cd7f7 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Temporary image da3b8763-8779-4977-b06e-6672830aabe2 for user b598be7a5a164033b2e658166b8c44b7 is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Marking volume b337c9df-23cf-40d1-8235-da203c1cd7f7 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:21:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Deleted volume successfully.
Sep 11 23:21:51 devstack sudo[106276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:21:51 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Copying metadata from image da3b8763-8779-4977-b06e-6672830aabe2 to b337c9df-23cf-40d1-8235-da203c1cd7f7. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Creating volume glance metadata for volume b337c9df-23cf-40d1-8235-da203c1cd7f7 backed by image da3b8763-8779-4977-b06e-6672830aabe2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'dbf2cd7bdaa19e79c092bb49e310bad1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-247134ee-5d17-44e7-9243-7125dfa1ae71 tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-d78ff689-6cc5-4c03-adcb-00ab9605424e-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:51 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792
Sep 11 23:21:51 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6126b3-9f6d-477a-85ea-7f815f95d178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b337c9df-23cf-40d1-8235-da203c1cd7f7', 'volume_size': 1, 'image_id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/da3b8763-8779-4977-b06e-6672830aabe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'dbf2cd7bdaa19e79c092bb49e310bad1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fd6bb64d519645a0b0f142990169189b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e7241327d62ab64e4bf13110f80535260724ac266a7d97108e45bc74c6b6a31dc789b5a57b8d2c95ad8bb891bff29771af555601a411d1dd31d61b4efa6f58b', 'id': 'da3b8763-8779-4977-b06e-6672830aabe2', 'created_at': datetime.datetime(2026, 9, 11, 21, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 21, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/da3b8763-8779-4977-b06e-6672830aabe2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb63e4950>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5aefcd-26f4-4419-928b-01f69e4cc5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Volume volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 (b337c9df-23cf-40d1-8235-da203c1cd7f7): created successfully
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e5aefcd-26f4-4419-928b-01f69e4cc5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Flow 'volume_create_manager' (00e945e8-3ef2-4a5c-8bd1-2417b1000a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1c79253d-13ba-4905-bf0b-9435f5095578 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Created volume successfully.
Sep 11 23:21:51 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.409s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621b1cee-9048-4206-807d-e0e94ef0dd4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d88044-7e1d-497d-b1b6-ec9867472170]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:51 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:21:51 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792" returned: 0 in 0.481s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:51 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792
Sep 11 23:21:51 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Acquiring lock "cinder-b337c9df-23cf-40d1-8235-da203c1cd7f7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "cinder-b337c9df-23cf-40d1-8235-da203c1cd7f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Acquiring lock "cinder-quobyte-b337c9df-23cf-40d1-8235-da203c1cd7f7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "cinder-quobyte-b337c9df-23cf-40d1-8235-da203c1cd7f7" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9758af-2af0-4d2a-881a-b0da798d31a5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:51 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.444s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:51 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-0c34b2c8-1577-4322-bd74-62e3ff84d792" returned: 0 in 0.315s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:51 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097
Sep 11 23:21:51 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7
Sep 11 23:21:51 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-quobyte-0c34b2c8-1577-4322-bd74-62e3ff84d792" released by "delete_volume" :: held 0.846s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Created reservations ['642982b2-6891-4888-a05e-251266b6cca8', 'f2c1ed00-c31d-4f6c-b2df-ae22e661bdb4', 'e68543c0-e475-4d7f-9ebd-6ab91e914ac8', 'a841d29e-c9e9-4623-803c-a4e83d2ed74c'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-769b3ecb-dfce-48b2-bb31-9d5720ef6964-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-769b3ecb-dfce-48b2-bb31-9d5720ef6964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-769b3ecb-dfce-48b2-bb31-9d5720ef6964" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-769b3ecb-dfce-48b2-bb31-9d5720ef6964" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Deleting offline snapshot 769b3ecb-dfce-48b2-bb31-9d5720ef6964 of volume a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] snapshot_file for this snap is: volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:21:52 devstack sudo[106301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:52 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cea74b-d5ec-4885-996a-c9554aac2840]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:52 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7" returned: 0 in 0.471s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:52 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7
Sep 11 23:21:52 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:52 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964
Sep 11 23:21:52 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:52 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.477s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Deleted volume successfully.
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2d85cfc1-a212-4655-a8fc-d93a3c2edcae tempest-CreateVolumesFromImageTest-929040804 None] Lock "cinder-0c34b2c8-1577-4322-bd74-62e3ff84d792-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:52 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-b337c9df-23cf-40d1-8235-da203c1cd7f7" returned: 0 in 0.492s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "cinder-quobyte-b337c9df-23cf-40d1-8235-da203c1cd7f7" released by "delete_volume" :: held 1.044s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:52 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964" returned: 0 in 0.628s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a379421d-c4d4-41c1-9a17-a17abdf26728(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2df6fb8-8031-41d2-af7a-a59a0b4d8bd6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Created reservations ['538569e0-5f76-4972-a1c3-5ea70ff20476', '2acfc680-73c0-4100-bc3a-015f3292586d', 'b76a3a69-9f03-4e32-b497-8e373bb5a0d4', 'f7e9950f-a678-4256-bb47-7b18260bf46a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:53 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728
Sep 11 23:21:53 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:53 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:53 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:53 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.451s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:53 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Deleted volume successfully.
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-610b4744-87eb-4c8e-a3ec-d883e64985e2 tempest-VolumeAndVolumeTypeFromImageTest-1092441997 None] Lock "cinder-b337c9df-23cf-40d1-8235-da203c1cd7f7-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:53 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728" returned: 0 in 0.958s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:53 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964
Sep 11 23:21:53 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:54 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964" returned: 0 in 0.794s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:54 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964
Sep 11 23:21:54 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:55 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728.769b3ecb-dfce-48b2-bb31-9d5720ef6964" returned: 0 in 1.061s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-769b3ecb-dfce-48b2-bb31-9d5720ef6964" released by "_delete_snapshot" :: held 3.700s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" released by "delete_snapshot" :: held 3.778s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:55 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Created reservations ['edc9977b-04c1-49fe-a456-fe09dd208516', 'f81ebfa0-6c9b-4f54-93ce-bf87ca0c521d', '91230646-cb66-4a31-8b6c-b98891db9de0', '72558067-90ef-47d8-a72e-30146f1505f6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:56 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Delete snapshot completed successfully.
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5a007f19-c198-43e5-9cf4-d0a9de1197dc tempest-ProjectReaderTests-362718808 None] Lock "cinder-769b3ecb-dfce-48b2-bb31-9d5720ef6964-delete_snapshot" released by "delete_snapshot" :: held 4.225s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-a379421d-c4d4-41c1-9a17-a17abdf26728-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "cinder-a379421d-c4d4-41c1-9a17-a17abdf26728-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" acquired by "delete_volume" :: waited 0.052s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c3196-03c3-41ba-93e2-990a78ecdbd8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:57 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728
Sep 11 23:21:57 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:58 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728" returned: 0 in 1.421s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:58 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728
Sep 11 23:21:58 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:58 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097" returned: 0 in 6.674s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:21:58 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Converted 1024.00 MB image at 153.41 MB/s
Sep 11 23:21:58 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 is being set with open permissions: ugo+rw
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:58 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097
Sep 11 23:21:58 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:58 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a379421d-c4d4-41c1-9a17-a17abdf26728" returned: 0 in 0.331s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-a379421d-c4d4-41c1-9a17-a17abdf26728" released by "delete_volume" :: held 1.955s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:58 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097" returned: 0 in 0.370s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Created reservations ['fa99e1e4-454c-4469-9494-df0d0b6ec447', '873c31df-60d3-41d0-becf-b22b9948a86d', '1aa6025b-8fde-4083-8818-1ed424ba9572', '5d8da701-465b-4197-922c-809d2b7dbcfa'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25-91ed07ab-bbcf-4554-8ef1-8638d41d0097" released by "_create_volume_from_snapshot" :: held 8.130s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.166s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94b5c15-c356-4e4e-b23c-9d2ea3013e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097', 'volume_size': 1, 'snapshot_id': '741c3dd2-1ed7-4f90-979c-8711fa108b25'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ae2bb-3334-40ba-bc8b-754a775d0452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:58 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Volume volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 (91ed07ab-bbcf-4554-8ef1-8638d41d0097): created successfully
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315ae2bb-3334-40ba-bc8b-754a775d0452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:58 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Flow 'volume_create_manager' (2fb9f8be-a899-4f1e-99e6-5b75c4e76440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a81707bd-9018-4039-89eb-581fa16d4abf tempest-VolumeDependencyTests-1505810515 None] Created volume successfully.
Sep 11 23:21:59 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:21:59 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:59 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.373s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:21:59 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Deleted volume successfully.
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-05decb37-0a27-4b41-b388-d88d717e6a0b tempest-ProjectReaderTests-362718808 None] Lock "cinder-a379421d-c4d4-41c1-9a17-a17abdf26728-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-741c3dd2-1ed7-4f90-979c-8711fa108b25-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-741c3dd2-1ed7-4f90-979c-8711fa108b25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (9f3d3b60-8fc7-4955-b9d4-68d71740af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c75a80-f75f-4025-83ab-e1e7b08f2f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1c75a80-f75f-4025-83ab-e1e7b08f2f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994278170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51188bd1-c0a6-4533-ba0a-3cd5909db2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:00Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aea1fa0-3c34-484a-b4b8-67ad7531328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aea1fa0-3c34-484a-b4b8-67ad7531328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f2ce6d-1edc-4279-ac3a-6b912e9d7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f2ce6d-1edc-4279-ac3a-6b912e9d7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51188bd1-c0a6-4533-ba0a-3cd5909db2da', 'volume_name': 'volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e78399-f9d9-464b-a45d-26abe22f7433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e78399-f9d9-464b-a45d-26abe22f7433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbdb5e7-7310-4624-8984-1be374fec3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume 51188bd1-c0a6-4533-ba0a-3cd5909db2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da', 'volume_size': 1}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1994278170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51188bd1-c0a6-4533-ba0a-3cd5909db2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:00Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume 51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:21:59 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25" acquired by "_delete_snapshot" :: waited 0.082s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Deleting offline snapshot 741c3dd2-1ed7-4f90-979c-8711fa108b25 of volume 621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:21:59 devstack sudo[106356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da 1073741824
Sep 11 23:21:59 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] snapshot_file for this snap is: volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ff545d-b36d-40bf-bd82-9360f8a3b65e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (9486d5cf-25ed-4cb9-8895-94310b81e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4c3e59-5356-4e01-88eb-a9f1bd9283fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:21:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4c3e59-5356-4e01-88eb-a9f1bd9283fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827199042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d567aa-606d-478e-b268-0a7ab62ac99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:00Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96505a8b-ece3-430b-ad3e-28252614e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96505a8b-ece3-430b-ad3e-28252614e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:22:00 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2986a35b-b716-436c-b99c-c917a0a28fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2986a35b-b716-436c-b99c-c917a0a28fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d567aa-606d-478e-b268-0a7ab62ac99f', 'volume_name': 'volume-52d567aa-606d-478e-b268-0a7ab62ac99f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcb291-78d5-4026-8d80-6d9d71331095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fcb291-78d5-4026-8d80-6d9d71331095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87bc35-4310-42e2-9b8a-05c4c2bf1d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Volume 52d567aa-606d-478e-b268-0a7ab62ac99f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d567aa-606d-478e-b268-0a7ab62ac99f', 'volume_size': 1}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:00 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-621b1cee-9048-4206-807d-e0e94ef0dd4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f1dd97-3172-415b-99b8-ae348d9ecd4e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:00 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da 1073741824" returned: 0 in 0.538s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:00 devstack sudo[106369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da
Sep 11 23:22:00 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:00 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:22:00 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:00 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.636s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1827199042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d567aa-606d-478e-b268-0a7ab62ac99f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:00Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Creating volume 52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:00 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbdb5e7-7310-4624-8984-1be374fec3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack sudo[106375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f 1073741824
Sep 11 23:22:00 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f409a7d-3529-450d-a447-41e872c99608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da (51188bd1-c0a6-4533-ba0a-3cd5909db2da): created successfully
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f409a7d-3529-450d-a447-41e872c99608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (9f3d3b60-8fc7-4955-b9d4-68d71740af3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8fae431a-ec32-43c5-aec5-8eebf027a541 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:00 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.601s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:00 devstack sudo[106378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:22:00 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:01 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f 1073741824" returned: 0 in 0.558s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:01 devstack sudo[106388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f
Sep 11 23:22:01 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:01 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.415s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:01 devstack sudo[106390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25
Sep 11 23:22:01 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:01 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f" returned: 0 in 0.263s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb87bc35-4310-42e2-9b8a-05c4c2bf1d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d567aa-606d-478e-b268-0a7ab62ac99f', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e6991b-faf2-4cc6-8b83-f949ba8c5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:01 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b.741c3dd2-1ed7-4f90-979c-8711fa108b25" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:01 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Volume volume-52d567aa-606d-478e-b268-0a7ab62ac99f (52d567aa-606d-478e-b268-0a7ab62ac99f): created successfully
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e6991b-faf2-4cc6-8b83-f949ba8c5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (9486d5cf-25ed-4cb9-8895-94310b81e537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-741c3dd2-1ed7-4f90-979c-8711fa108b25" released by "_delete_snapshot" :: held 1.802s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" released by "delete_snapshot" :: held 1.896s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0ec7da77-ccd3-4e50-82af-feab55df334c tempest-ProjectReaderTests-362718808 None] Created volume successfully.
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Created reservations ['d2bbf524-78eb-4ed5-9e5d-a474d9a5e197', '8a332366-1099-4315-ae0d-2a110264743a', 'a6a69122-6dad-48d6-80a1-e14b38bf329f', '4a36c29f-3603-4275-9416-b9d2d42243a0'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Delete snapshot completed successfully.
Sep 11 23:22:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-dbfd1adb-9382-49e3-b445-605aa01af2fa tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-741c3dd2-1ed7-4f90-979c-8711fa108b25-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-621b1cee-9048-4206-807d-e0e94ef0dd4b-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-621b1cee-9048-4206-807d-e0e94ef0dd4b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[481fbb65-5700-4eae-a590-7e3697622e20]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (e2c2570a-370c-47d6-b889-1d11bc740559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f400f3-3375-41a9-a726-070ddbccce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:02 devstack sudo[106394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:22:02 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating offline snapshot 63454418-337a-4970-a93f-21a4089cdd3f of volume 51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f400f3-3375-41a9-a726-070ddbccce9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867805955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0433637-8244-4de9-96ea-1a97cdefe6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:02Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262de4e0-84eb-4b45-bc8f-4067b2f22579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (262de4e0-84eb-4b45-bc8f-4067b2f22579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7016edfd-62b1-4ce1-bb2d-d92c362caa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7016edfd-62b1-4ce1-bb2d-d92c362caa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0433637-8244-4de9-96ea-1a97cdefe6b1', 'volume_name': 'volume-f0433637-8244-4de9-96ea-1a97cdefe6b1', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b26e11-5523-42b9-9285-d6b3b2a57775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b26e11-5523-42b9-9285-d6b3b2a57775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c7efd-85e3-4cc6-a526-303aebe1dc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:02 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume f0433637-8244-4de9-96ea-1a97cdefe6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0433637-8244-4de9-96ea-1a97cdefe6b1', 'volume_size': 1}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7974c1-b7af-4f5b-948c-b51608f9519b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:02 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da
Sep 11 23:22:02 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:02 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:02 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b
Sep 11 23:22:02 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:02 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da" returned: 0 in 0.370s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:02 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f 1G
Sep 11 23:22:02 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:02 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-621b1cee-9048-4206-807d-e0e94ef0dd4b" returned: 0 in 0.234s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-621b1cee-9048-4206-807d-e0e94ef0dd4b" released by "delete_volume" :: held 0.739s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:02 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Created reservations ['4623051a-b130-431f-a38e-4ef5e797eae0', '7b4f7b2e-8c81-49ae-a38e-5dc53843d726', '10b1d19b-3894-4849-9f35-ce862c1044f5', '8c88a78d-431a-4ed6-80cf-335aa7421883'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:03 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:03 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f 1G" returned: 0 in 0.496s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-91ed07ab-bbcf-4554-8ef1-8638d41d0097-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.294s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:03 devstack sudo[106416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f
Sep 11 23:22:03 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Deleted volume successfully.
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-91ed07ab-bbcf-4554-8ef1-8638d41d0097-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe4570d5-a154-4551-9621-cd83d58801fc tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-621b1cee-9048-4206-807d-e0e94ef0dd4b-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd9d1b-e9d2-4d24-a681-d24a51eaac03]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097
Sep 11 23:22:03 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:03 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f" returned: 0 in 0.337s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:03 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f is being set with open permissions: ugo+rw
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f
Sep 11 23:22:03 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:03 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097" returned: 0 in 0.358s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097
Sep 11 23:22:03 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:03 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:03 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info
Sep 11 23:22:04 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:04 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-91ed07ab-bbcf-4554-8ef1-8638d41d0097" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-quobyte-91ed07ab-bbcf-4554-8ef1-8638d41d0097" released by "delete_volume" :: held 0.632s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Created reservations ['f5cc536f-fd30-4803-8c68-e2d65a20455c', '96022c4c-e2ec-4854-a6c5-6ac3f6281a3f', '13efcff4-77a9-468e-819a-3b9023db98d3', 'b580444b-2096-4e5f-9f77-dd3ed296e153'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:04 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info" returned: 0 in 0.275s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:04 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info is being set with open permissions: ugo+rw
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:04 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:04 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:04 devstack sudo[106436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info
Sep 11 23:22:04 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:04 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:04 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.info" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.151s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Deleted volume successfully.
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.053s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867805955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0433637-8244-4de9-96ea-1a97cdefe6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:02Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume f0433637-8244-4de9-96ea-1a97cdefe6b1 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:04 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:04 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 1073741824
Sep 11 23:22:04 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:04 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-b19b4acf-2e6b-4c3c-b3c2-3111d0e3e4cb tempest-VolumeDependencyTests-1505810515 None] Lock "cinder-91ed07ab-bbcf-4554-8ef1-8638d41d0097-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-62555098-50c0-4160-968f-c0b98206cd34 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Create snapshot completed successfully
Sep 11 23:22:05 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 1073741824" returned: 0 in 0.523s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:05 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1
Sep 11 23:22:05 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:05 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1" returned: 0 in 0.274s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.883s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Creating offline snapshot b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 of volume 52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c7efd-85e3-4cc6-a526-303aebe1dc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0433637-8244-4de9-96ea-1a97cdefe6b1', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc19c4f1-d221-45b5-b7b2-9446a7a4b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb340fc-2e9d-4401-9c2e-6efa4da192c6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:05 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 (f0433637-8244-4de9-96ea-1a97cdefe6b1): created successfully
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc19c4f1-d221-45b5-b7b2-9446a7a4b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (e2c2570a-370c-47d6-b889-1d11bc740559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:05 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-592b4439-a637-4f42-8f8a-4f622ed3cc1d tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:05 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f
Sep 11 23:22:05 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (6c5b844d-591e-48e0-a604-17146a2b5d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97105e4b-9f9b-4a97-a3b7-65a3e8b4e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97105e4b-9f9b-4a97-a3b7-65a3e8b4e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465690512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:06Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61141c81-75e4-4945-9374-37306baa772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61141c81-75e4-4945-9374-37306baa772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46308cb-d44a-40a7-8b83-de05a8b00cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46308cb-d44a-40a7-8b83-de05a8b00cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc', 'volume_name': 'volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d0242b-45db-4f8a-b14a-409d46c91115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:05 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4d0242b-45db-4f8a-b14a-409d46c91115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d82b8-b737-4ea9-8113-6fae03cc67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc', 'volume_size': 1}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:06 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f" returned: 0 in 0.587s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:06 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 1G
Sep 11 23:22:06 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (2c4ae747-36a6-4524-a902-8baa100affa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6712674f-6bd5-44bc-b6f4-8792147bef4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6712674f-6bd5-44bc-b6f4-8792147bef4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419132370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961ebf33-42dd-4ebe-b06f-646430ccd0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:06Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cc8679-0ace-4f53-8d6e-ecf9819b70ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cc8679-0ace-4f53-8d6e-ecf9819b70ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a05cc0c-1276-43e7-a55b-ad98744b885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a05cc0c-1276-43e7-a55b-ad98744b885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '961ebf33-42dd-4ebe-b06f-646430ccd0bf', 'volume_name': 'volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6564a-57a1-4ee3-9e8d-b075f0a69f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b6564a-57a1-4ee3-9e8d-b075f0a69f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd33bb68-c685-4c8e-ab67-dee0bf98dfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume 961ebf33-42dd-4ebe-b06f-646430ccd0bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf', 'volume_size': 1}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:06 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 1G" returned: 0 in 0.745s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d567aa-606d-478e-b268-0a7ab62ac99f -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:06 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d567aa-606d-478e-b268-0a7ab62ac99f -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15
Sep 11 23:22:06 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (5912e0ee-dc73-4395-a907-57e6f2e96dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0eb0b8-7a96-4b99-85a6-ea1f92b96990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:06 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea0eb0b8-7a96-4b99-85a6-ea1f92b96990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504742626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5efda1-1ab3-42e6-aaff-6a33cc538f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:07Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d77fe-ee3f-4911-81e0-1c7e6db3b896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50d77fe-ee3f-4911-81e0-1c7e6db3b896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5808b08a-295f-4b99-a36b-2cab488cca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5808b08a-295f-4b99-a36b-2cab488cca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5efda1-1ab3-42e6-aaff-6a33cc538f19', 'volume_name': 'volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089f7ca6-0f02-4025-98d2-a9a24546d043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (089f7ca6-0f02-4025-98d2-a9a24546d043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737d9175-6bf4-4093-867a-107fd017e538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume af5efda1-1ab3-42e6-aaff-6a33cc538f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19', 'volume_size': 1}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:07 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52d567aa-606d-478e-b268-0a7ab62ac99f -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" returned: 0 in 0.552s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:07 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 is being set with open permissions: ugo+rw
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:07 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15
Sep 11 23:22:07 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:07 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" returned: 0 in 0.343s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:07 devstack sudo[106473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info
Sep 11 23:22:07 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (03f48050-c2a9-4d29-979a-27246d3c65e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce25572-7496-4132-8a45-681280aeb366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cce25572-7496-4132-8a45-681280aeb366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716062984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a81b30-14b2-449b-92f2-afa43b486b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:07Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a173072a-fb5c-4311-8eba-543af9883e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a173072a-fb5c-4311-8eba-543af9883e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9259388-6483-4f48-8810-25a157a24dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9259388-6483-4f48-8810-25a157a24dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a81b30-14b2-449b-92f2-afa43b486b29', 'volume_name': 'volume-41a81b30-14b2-449b-92f2-afa43b486b29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d6dde9-7b33-4808-bca6-3e5591b8b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d6dde9-7b33-4808-bca6-3e5591b8b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3f8d2-e0ea-43f2-87b8-c9715ac7492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume 41a81b30-14b2-449b-92f2-afa43b486b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a81b30-14b2-449b-92f2-afa43b486b29', 'volume_size': 1}
Sep 11 23:22:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:08 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info" returned: 0 in 0.347s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:08 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info is being set with open permissions: ugo+rw
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:08 devstack sudo[106477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info
Sep 11 23:22:08 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (cd41d440-ba11-4185-93c3-16f0e3e09209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d5ee6d-ce49-4832-8223-a8c4cb899066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d5ee6d-ce49-4832-8223-a8c4cb899066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408938510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db0cd77-d948-42c6-a9e8-bcd55042e60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:08Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313cbe2c-1626-464c-88b9-a61877293b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313cbe2c-1626-464c-88b9-a61877293b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7b2096-821d-40df-b94d-b05cd440c81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7b2096-821d-40df-b94d-b05cd440c81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db0cd77-d948-42c6-a9e8-bcd55042e60c', 'volume_name': 'volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ef550c-affb-403e-8ecf-aade305e9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96ef550c-affb-403e-8ecf-aade305e9b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e8889-011d-4333-b2dc-2cb2e10f3396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume 9db0cd77-d948-42c6-a9e8-bcd55042e60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c', 'volume_size': 1}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:08 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.info" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.074s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.467s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-465690512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:06Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:08 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:08 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc 1073741824
Sep 11 23:22:08 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8f7024bf-aceb-41c0-93b8-4c19af01b7e7 tempest-ProjectReaderTests-362718808 None] Create snapshot completed successfully
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (57a44c5c-2efb-4e69-8e05-ae51f5eece1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52521e7-9d5b-41ac-bbc7-a077aa3ce072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52521e7-9d5b-41ac-bbc7-a077aa3ce072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462702351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49d3da7-6e23-449d-b0f9-b747e79be68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:08Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac6817-3d80-42fa-9af7-b47fb6174541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac6817-3d80-42fa-9af7-b47fb6174541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3235423-de0f-49b0-8870-198f3d8bb9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3235423-de0f-49b0-8870-198f3d8bb9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49d3da7-6e23-449d-b0f9-b747e79be68a', 'volume_name': 'volume-d49d3da7-6e23-449d-b0f9-b747e79be68a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0f924-0889-488b-8882-728a36560611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c0f924-0889-488b-8882-728a36560611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb1accd-6bb1-411b-ba20-e9a9f936c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume d49d3da7-6e23-449d-b0f9-b747e79be68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49d3da7-6e23-449d-b0f9-b747e79be68a', 'volume_size': 1}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (5278a169-65e8-4f37-b5dc-39501aa987cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a37f3-b49c-4e31-9c58-16a908944a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (025a37f3-b49c-4e31-9c58-16a908944a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111085287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4785aeb2-35e9-46ed-82a4-4a1df221e2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b267e773-065d-447f-9833-55fb3f25e784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b267e773-065d-447f-9833-55fb3f25e784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbe6865-1edd-432a-ad95-b980549e6b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dbe6865-1edd-432a-ad95-b980549e6b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4785aeb2-35e9-46ed-82a4-4a1df221e2fe', 'volume_name': 'volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b325f03a-369c-4757-b718-889430621cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b325f03a-369c-4757-b718-889430621cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773cc95a-34ee-4040-8f9d-abc7dee00e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume 4785aeb2-35e9-46ed-82a4-4a1df221e2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe', 'volume_size': 1}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (388fa2ca-8f66-422b-8689-7c99219fe996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f5d5e2-5093-48b5-bd6e-4589d489a84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f5d5e2-5093-48b5-bd6e-4589d489a84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424158422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d364f0-ec68-47e7-8271-1a4ec6587882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5a123-163d-4a26-a823-d240ec3c76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f5a123-163d-4a26-a823-d240ec3c76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a8926-66ed-4ef0-9f96-2e2d02dfcab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79a8926-66ed-4ef0-9f96-2e2d02dfcab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d364f0-ec68-47e7-8271-1a4ec6587882', 'volume_name': 'volume-17d364f0-ec68-47e7-8271-1a4ec6587882', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272274e9-23a5-4483-bd79-68ec8bb044ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272274e9-23a5-4483-bd79-68ec8bb044ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24086f5b-4e83-4c7b-8344-e292a6f02eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume 17d364f0-ec68-47e7-8271-1a4ec6587882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d364f0-ec68-47e7-8271-1a4ec6587882', 'volume_size': 1}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:09 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc 1073741824" returned: 0 in 0.706s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Deleting offline snapshot b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 of volume 52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] snapshot_file for this snap is: volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8b71b-4bb1-46e5-bd62-3e749af80a14]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:09 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc
Sep 11 23:22:09 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (3cbc929d-a6c8-4370-9427-5f5783467d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc88f1f7-89f9-40db-87a4-db816741b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc88f1f7-89f9-40db-87a4-db816741b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1134808918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895c042-a4ef-4285-af31-18029321228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3ec88-3feb-4279-85fe-df40873cdf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15
Sep 11 23:22:09 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3ec88-3feb-4279-85fe-df40873cdf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30173ebf-2725-45a0-acee-121a842e10cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30173ebf-2725-45a0-acee-121a842e10cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd895c042-a4ef-4285-af31-18029321228d', 'volume_name': 'volume-d895c042-a4ef-4285-af31-18029321228d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b5c4b0-bbde-4f41-ab23-df51cb3cf8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b5c4b0-bbde-4f41-ab23-df51cb3cf8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe17177f-9945-430c-adc8-9cca3388d5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume d895c042-a4ef-4285-af31-18029321228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d895c042-a4ef-4285-af31-18029321228d', 'volume_size': 1}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Flow 'volume_create_manager' (5fab8d53-cb5e-48d3-9fc7-d181f134d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a440d10b-943a-4f56-9724-f63714672a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a440d10b-943a-4f56-9724-f63714672a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1917f78c-69a5-40d3-b561-003537b927f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff09c62efb4c40bb9e07e0df653258b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='cc815b5134dc476d9a87b3b6f990f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b8e5c-0c59-4dae-8213-b305a66fcc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76b8e5c-0c59-4dae-8213-b305a66fcc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e43ecea-9b33-41d2-a654-504903621909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e43ecea-9b33-41d2-a654-504903621909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1917f78c-69a5-40d3-b561-003537b927f7', 'volume_name': 'volume-1917f78c-69a5-40d3-b561-003537b927f7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44919322-e51c-41b0-99f7-0ce81c3ed14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44919322-e51c-41b0-99f7-0ce81c3ed14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935175a3-230c-4a1c-90e1-c1b48ec410ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Volume 1917f78c-69a5-40d3-b561-003537b927f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1917f78c-69a5-40d3-b561-003537b927f7', 'volume_size': 1}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:09 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (61671dd7-6e25-481d-b0ca-550809ea57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964d4b07-c6ae-4773-ba96-a585ba50bf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" returned: 0 in 0.331s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.030s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1419132370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=961ebf33-42dd-4ebe-b06f-646430ccd0bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:06Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume 961ebf33-42dd-4ebe-b06f-646430ccd0bf {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964d4b07-c6ae-4773-ba96-a585ba50bf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2068006959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f4bb8-ee29-4e30-8aa7-edbf22c1e888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087377f8-c673-4191-ab3d-915560b87a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf 1073741824
Sep 11 23:22:09 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087377f8-c673-4191-ab3d-915560b87a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20327bd4-ea18-4577-a3b1-d4505bac7b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20327bd4-ea18-4577-a3b1-d4505bac7b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826f4bb8-ee29-4e30-8aa7-edbf22c1e888', 'volume_name': 'volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a123881a-de88-4213-9aaa-c2fc9a061426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a123881a-de88-4213-9aaa-c2fc9a061426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5ef3a2-cc01-4572-bdd2-678046c8de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume 826f4bb8-ee29-4e30-8aa7-edbf22c1e888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888', 'volume_size': 1}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d82b8-b737-4ea9-8113-6fae03cc67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5718ff96-babb-4eec-b4e5-abf4f106c87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" returned: 0 in 0.411s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52d567aa-606d-478e-b268-0a7ab62ac99f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7944415-5749-4a3f-8231-6395a4e9adb0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc (a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc): created successfully
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5718ff96-babb-4eec-b4e5-abf4f106c87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:09 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (6c5b844d-591e-48e0-a604-17146a2b5d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f68197da-b564-4c15-bf07-bd198aefe9d5 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:09 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f
Sep 11 23:22:09 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf 1073741824" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:10 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:10 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf
Sep 11 23:22:10 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15
Sep 11 23:22:10 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.256s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504742626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5efda1-1ab3-42e6-aaff-6a33cc538f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:07Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume af5efda1-1ab3-42e6-aaff-6a33cc538f19 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:10 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd33bb68-c685-4c8e-ab67-dee0bf98dfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:10 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 1073741824
Sep 11 23:22:10 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbe2b42-1a9e-4eeb-9f43-f22902734c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:10 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf (961ebf33-42dd-4ebe-b06f-646430ccd0bf): created successfully
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbe2b42-1a9e-4eeb-9f43-f22902734c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (2c4ae747-36a6-4524-a902-8baa100affa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9aa9a1ca-207a-4bdd-b118-2f28d57dd84b tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:10 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" returned: 0 in 0.346s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:10 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15
Sep 11 23:22:10 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f.b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15" released by "_delete_snapshot" :: held 1.509s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" released by "delete_snapshot" :: held 1.535s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:10 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 1073741824" returned: 0 in 0.432s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Created reservations ['1cac94ff-c2c5-4055-ab17-0f2e569eaf59', '65a733ff-88cd-41ad-a080-8f18c50766b0', '5d6789e1-437c-4dc6-9875-eea53da5caaf', '87e4bcac-888a-44f8-8c39-705d7ebc63db'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:10 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19
Sep 11 23:22:10 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:10 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Delete snapshot completed successfully.
Sep 11 23:22:10 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1b759058-d54d-4b89-924a-0106dde5e5f1 tempest-ProjectReaderTests-362718808 None] Lock "cinder-b9556b32-a4e5-4d48-9c4b-ae2cf2a78d15-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:11 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.217s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-716062984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a81b30-14b2-449b-92f2-afa43b486b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:07Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume 41a81b30-14b2-449b-92f2-afa43b486b29 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737d9175-6bf4-4093-867a-107fd017e538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:11 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 1073741824
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa79e21-8145-4fee-859c-bf55f732945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:11 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 (af5efda1-1ab3-42e6-aaff-6a33cc538f19): created successfully
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa79e21-8145-4fee-859c-bf55f732945e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (5912e0ee-dc73-4395-a907-57e6f2e96dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4c5554ca-c76b-4efa-8d16-cbbd8af69fff tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-52d567aa-606d-478e-b268-0a7ab62ac99f-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "cinder-52d567aa-606d-478e-b268-0a7ab62ac99f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[72668919-9dfe-4cc6-8375-8b4ec04273ac]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:11 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:11 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f
Sep 11 23:22:11 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 1073741824" returned: 0 in 0.492s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:11 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29
Sep 11 23:22:11 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:11 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f" returned: 0 in 0.355s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:11 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f
Sep 11 23:22:11 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:11 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29" returned: 0 in 0.251s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.534s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408938510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db0cd77-d948-42c6-a9e8-bcd55042e60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:08Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume 9db0cd77-d948-42c6-a9e8-bcd55042e60c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e3f8d2-e0ea-43f2-87b8-c9715ac7492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a81b30-14b2-449b-92f2-afa43b486b29', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:11 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c 1073741824
Sep 11 23:22:11 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d3e893-b768-4a9d-8e88-cf1fea3df81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-41a81b30-14b2-449b-92f2-afa43b486b29 (41a81b30-14b2-449b-92f2-afa43b486b29): created successfully
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d3e893-b768-4a9d-8e88-cf1fea3df81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:11 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (03f48050-c2a9-4d29-979a-27246d3c65e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-54f89ab4-f642-48fd-a70b-1ad18244c0e7 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:12 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-52d567aa-606d-478e-b268-0a7ab62ac99f" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-52d567aa-606d-478e-b268-0a7ab62ac99f" released by "delete_volume" :: held 0.693s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Created reservations ['d9ed542e-eaa8-474e-8cdd-c25e3f87c649', '98dda06c-97d5-4821-b016-6ec4ae2bebc5', '0497437c-1504-415e-9f08-11d09c2d8ac7', '1b0d1ab6-31c4-44fe-99ea-deb7573fea75'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:12 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:12 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:12 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c 1073741824" returned: 0 in 0.484s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:12 devstack sudo[106553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c
Sep 11 23:22:12 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:12 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Deleted volume successfully.
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-7bf9d7b9-52f2-4117-98d9-9e80a2bbe184 tempest-ProjectReaderTests-362718808 None] Lock "cinder-52d567aa-606d-478e-b268-0a7ab62ac99f-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:12 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.929s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462702351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49d3da7-6e23-449d-b0f9-b747e79be68a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae59f131e9654c589eea834115331565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:08Z,use_quota=True,user_id='fbff12ed1e624d47a3fd130233f78962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Creating volume d49d3da7-6e23-449d-b0f9-b747e79be68a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:12 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:12 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a 1073741824
Sep 11 23:22:12 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235e8889-011d-4333-b2dc-2cb2e10f3396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8355bc2-8e8c-4c08-9f90-5c7c7c84e023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:12 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c (9db0cd77-d948-42c6-a9e8-bcd55042e60c): created successfully
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8355bc2-8e8c-4c08-9f90-5c7c7c84e023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:12 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (cd41d440-ba11-4185-93c3-16f0e3e09209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:12 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4fafdc02-5325-4bb3-afda-f05c04712486 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (2b70bdbd-7912-4e92-8011-6746577fa830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a165479-42c6-4210-967d-3eac24ad05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a165479-42c6-4210-967d-3eac24ad05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744026544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:13Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b86ea1-b2e0-4894-921b-e79d119b4ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b86ea1-b2e0-4894-921b-e79d119b4ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0af1ea5-4c32-44e4-a3f2-bf75d024182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0af1ea5-4c32-44e4-a3f2-bf75d024182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0', 'volume_name': 'volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74dfc83-3e97-479c-8ee4-7c601fde0bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74dfc83-3e97-479c-8ee4-7c601fde0bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b069af80-904d-4bc6-b833-cb7ff673d17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Volume 6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0', 'volume_size': 1}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:13 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a 1073741824" returned: 0 in 0.466s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:13 devstack sudo[106564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a
Sep 11 23:22:13 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:13 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.564s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2111085287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4785aeb2-35e9-46ed-82a4-4a1df221e2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume 4785aeb2-35e9-46ed-82a4-4a1df221e2fe {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:13 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:13 devstack sudo[106567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe 1073741824
Sep 11 23:22:13 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb1accd-6bb1-411b-ba20-e9a9f936c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49d3da7-6e23-449d-b0f9-b747e79be68a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3e4fe2-6f6c-4537-ba44-de0baefa2d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:13 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Volume volume-d49d3da7-6e23-449d-b0f9-b747e79be68a (d49d3da7-6e23-449d-b0f9-b747e79be68a): created successfully
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3e4fe2-6f6c-4537-ba44-de0baefa2d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Flow 'volume_create_manager' (57a44c5c-2efb-4e69-8e05-ae51f5eece1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-27fcf945-3243-45be-8797-8b81f5c52718 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created volume successfully.
Sep 11 23:22:13 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe 1073741824" returned: 0 in 0.405s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:13 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe
Sep 11 23:22:13 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:14 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.173s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-424158422',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d364f0-ec68-47e7-8271-1a4ec6587882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume 17d364f0-ec68-47e7-8271-1a4ec6587882 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:14 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (773cc95a-34ee-4040-8f9d-abc7dee00e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:14 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 1073741824
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402ce7b6-a35e-4015-81ca-7e974e3e96de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:14 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:14 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe (4785aeb2-35e9-46ed-82a4-4a1df221e2fe): created successfully
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402ce7b6-a35e-4015-81ca-7e974e3e96de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (5278a169-65e8-4f37-b5dc-39501aa987cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:14 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f9610480-bbe6-4e8d-95d2-8a0b614a8194 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:14 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 1073741824" returned: 0 in 0.467s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-d49d3da7-6e23-449d-b0f9-b747e79be68a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-d49d3da7-6e23-449d-b0f9-b747e79be68a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:14 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882
Sep 11 23:22:14 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-d49d3da7-6e23-449d-b0f9-b747e79be68a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-d49d3da7-6e23-449d-b0f9-b747e79be68a" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6680ea01-4213-47dd-b573-fb7b76600c85]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:14 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a
Sep 11 23:22:14 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:14 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.531s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1134808918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895c042-a4ef-4285-af31-18029321228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume d895c042-a4ef-4285-af31-18029321228d {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:14 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24086f5b-4e83-4c7b-8344-e292a6f02eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d364f0-ec68-47e7-8271-1a4ec6587882', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:15 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d 1073741824
Sep 11 23:22:15 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954b4205-450e-4f2b-ad91-7da7985523be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-17d364f0-ec68-47e7-8271-1a4ec6587882 (17d364f0-ec68-47e7-8271-1a4ec6587882): created successfully
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954b4205-450e-4f2b-ad91-7da7985523be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (388fa2ca-8f66-422b-8689-7c99219fe996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4edff1c2-40b1-42fa-a9f2-ab5ae357d1e5 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:15 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:15 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a
Sep 11 23:22:15 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:15 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d 1073741824" returned: 0 in 0.421s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:15 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d49d3da7-6e23-449d-b0f9-b747e79be68a" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:15 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d
Sep 11 23:22:15 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-d49d3da7-6e23-449d-b0f9-b747e79be68a" released by "delete_volume" :: held 0.683s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['30682a6c-293b-439a-ade5-e3f0cc49e908', 'a8bdfde2-d37d-42bb-a3dc-e6fd22ab94e8', 'b579d1fc-fbf4-4201-8b1c-8ce0a06dabe8', '139442ca-9b91-40f5-a09a-c34edacaab83'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:15 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:15 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:15 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d" returned: 0 in 0.243s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.135s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1917f78c-69a5-40d3-b561-003537b927f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff09c62efb4c40bb9e07e0df653258b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='cc815b5134dc476d9a87b3b6f990f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Creating volume 1917f78c-69a5-40d3-b561-003537b927f7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:15 devstack sudo[106637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 1073741824
Sep 11 23:22:15 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe17177f-9945-430c-adc8-9cca3388d5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d895c042-a4ef-4285-af31-18029321228d', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e3420d-6f50-47e5-bb9d-6d00cf923f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-d895c042-a4ef-4285-af31-18029321228d (d895c042-a4ef-4285-af31-18029321228d): created successfully
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e3420d-6f50-47e5-bb9d-6d00cf923f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (3cbc929d-a6c8-4370-9427-5f5783467d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d2c50a8c-90e6-45b6-8807-d1a78fa72339 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:15 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.293s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-9db0cd77-d948-42c6-a9e8-bcd55042e60c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-93841205-2643-4192-a6c6-a53468242749 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-d49d3da7-6e23-449d-b0f9-b747e79be68a-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-9db0cd77-d948-42c6-a9e8-bcd55042e60c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-9db0cd77-d948-42c6-a9e8-bcd55042e60c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-9db0cd77-d948-42c6-a9e8-bcd55042e60c" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fcac06-5480-4ea3-8706-10350580af05]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:16 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:16 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 1073741824" returned: 0 in 0.477s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:16 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:16 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7
Sep 11 23:22:16 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:16 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:16 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c
Sep 11 23:22:16 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:16 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7" returned: 0 in 0.248s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.791s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2068006959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826f4bb8-ee29-4e30-8aa7-edbf22c1e888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee7c04571ce40bfa2b774ce227460be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:09Z,use_quota=True,user_id='0f0a819b65f84017a55e292e3b3124ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Creating volume 826f4bb8-ee29-4e30-8aa7-edbf22c1e888 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:16 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:16 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 1073741824
Sep 11 23:22:16 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935175a3-230c-4a1c-90e1-c1b48ec410ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1917f78c-69a5-40d3-b561-003537b927f7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb64450-f514-409f-b46c-59663365c96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Volume volume-1917f78c-69a5-40d3-b561-003537b927f7 (1917f78c-69a5-40d3-b561-003537b927f7): created successfully
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb64450-f514-409f-b46c-59663365c96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Flow 'volume_create_manager' (5fab8d53-cb5e-48d3-9fc7-d181f134d079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fbe431bf-7240-4f97-b233-20dad2b770c5 tempest-CinderUnicodeTest-1173051644 None] Created volume successfully.
Sep 11 23:22:16 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-9db0cd77-d948-42c6-a9e8-bcd55042e60c" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-9db0cd77-d948-42c6-a9e8-bcd55042e60c" released by "delete_volume" :: held 0.681s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['69f9cd6f-5eed-4c35-ad7f-ca8bc7602fe0', 'bd6a2f8d-3810-4302-b6d8-7eae7de7c667', 'ce16f004-c20d-4c2e-9cde-cab321816bd0', '03a26190-06cc-41d5-b598-d8e0b5eb39ee'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:16 devstack sudo[106663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:16 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:16 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 1073741824" returned: 0 in 0.453s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:17 devstack sudo[106666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888
Sep 11 23:22:17 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:17 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.269s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-af5efda1-1ab3-42e6-aaff-6a33cc538f19-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-af5efda1-1ab3-42e6-aaff-6a33cc538f19-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd850921-df35-468f-ad59-631fce03d3e6 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-9db0cd77-d948-42c6-a9e8-bcd55042e60c-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-af5efda1-1ab3-42e6-aaff-6a33cc538f19" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:17 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" returned: 0 in 0.291s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-af5efda1-1ab3-42e6-aaff-6a33cc538f19" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.150s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744026544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:13Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Creating volume 6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:17 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b90d2-9cc9-4fb0-983a-cf916856437b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:17 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 1073741824
Sep 11 23:22:17 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5ef3a2-cc01-4572-bdd2-678046c8de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564688bd-dddd-446b-856d-c8daac5b6c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:17 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Volume volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 (826f4bb8-ee29-4e30-8aa7-edbf22c1e888): created successfully
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564688bd-dddd-446b-856d-c8daac5b6c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Flow 'volume_create_manager' (61671dd7-6e25-481d-b0ca-550809ea57e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:17 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9db3e6d7-7041-472e-b5b9-f3395b16f309 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created volume successfully.
Sep 11 23:22:17 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19
Sep 11 23:22:17 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:17 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:17 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19
Sep 11 23:22:17 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:17 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 1073741824" returned: 0 in 0.519s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:17 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0
Sep 11 23:22:17 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:17 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-af5efda1-1ab3-42e6-aaff-6a33cc538f19" returned: 0 in 0.273s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-af5efda1-1ab3-42e6-aaff-6a33cc538f19" released by "delete_volume" :: held 0.714s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['7da95aeb-460b-4e77-b419-d2a1b0309714', '5b60819d-9064-4efe-be94-b6e9067e8504', '051e54ae-729c-4222-94c2-613b1035f7a0', '5ed995f3-743e-44ac-ade4-e3edef507f4e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-826f4bb8-ee29-4e30-8aa7-edbf22c1e888-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:18 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-826f4bb8-ee29-4e30-8aa7-edbf22c1e888-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" returned: 0 in 0.396s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b069af80-904d-4bc6-b833-cb7ff673d17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e15eacc-49c3-40c2-910d-b0dfbdd2ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-961ebf33-42dd-4ebe-b06f-646430ccd0bf-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:18 devstack sudo[106687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:18 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Volume volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 (6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0): created successfully
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e15eacc-49c3-40c2-910d-b0dfbdd2ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (2b70bdbd-7912-4e92-8011-6746577fa830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-961ebf33-42dd-4ebe-b06f-646430ccd0bf-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0ec6bb8b-f5ee-440d-a98e-2dcb555e4bd9 tempest-ProjectReaderTests-362718808 None] Created volume successfully.
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Flow 'volume_create_manager' (d5411ce0-204c-43f7-9b73-7c0a1f5058ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a0834-8349-4552-80c7-241029376ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb86de-d552-4ab6-837f-199f559e1a1f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-961ebf33-42dd-4ebe-b06f-646430ccd0bf" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10a0834-8349-4552-80c7-241029376ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1850318144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e80df2-3e3f-4a90-a5af-73bd5910361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff09c62efb4c40bb9e07e0df653258b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:18Z,use_quota=True,user_id='cc815b5134dc476d9a87b3b6f990f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cc1e0b-a0e3-4919-aca5-09b57a12c171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23cc1e0b-a0e3-4919-aca5-09b57a12c171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e05a16-8149-4369-b5b3-43807029b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e05a16-8149-4369-b5b3-43807029b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24e80df2-3e3f-4a90-a5af-73bd5910361a', 'volume_name': 'volume-24e80df2-3e3f-4a90-a5af-73bd5910361a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94c7453-c3a7-4449-ad89-0dbd33dce8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94c7453-c3a7-4449-ad89-0dbd33dce8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d71e970-b16a-49af-b814-7fcf1c919f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:18 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Volume 24e80df2-3e3f-4a90-a5af-73bd5910361a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24e80df2-3e3f-4a90-a5af-73bd5910361a', 'volume_size': 1}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1850318144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24e80df2-3e3f-4a90-a5af-73bd5910361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff09c62efb4c40bb9e07e0df653258b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:18Z,use_quota=True,user_id='cc815b5134dc476d9a87b3b6f990f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Creating volume 24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:18 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:18 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-961ebf33-42dd-4ebe-b06f-646430ccd0bf" acquired by "delete_volume" :: waited 0.107s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:18 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a 1073741824
Sep 11 23:22:18 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.281s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:18 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:18 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888
Sep 11 23:22:18 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6788c1-ca30-4068-b7d1-7fc30cde3f8e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84ab5332-4452-4e55-8819-951927e75d17 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-af5efda1-1ab3-42e6-aaff-6a33cc538f19-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:18 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf
Sep 11 23:22:18 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:18 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" returned: 0 in 0.392s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack sudo[106703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888
Sep 11 23:22:19 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:19 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf" returned: 0 in 0.417s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf
Sep 11 23:22:19 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:19 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a 1073741824" returned: 0 in 0.534s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack sudo[106712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a
Sep 11 23:22:19 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" returned: 0 in 0.313s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-826f4bb8-ee29-4e30-8aa7-edbf22c1e888" released by "delete_volume" :: held 0.791s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['34517b56-ea92-4851-b804-13a7e8cbed92', 'd3620e8c-8de1-49f9-8bae-fc50a79e4c22', 'c6b6f585-dd54-4e56-a481-a765304a9cbb', '3ff94fb7-ec51-4d67-a09e-56add0e6b44d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:19 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-961ebf33-42dd-4ebe-b06f-646430ccd0bf" returned: 0 in 0.338s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-961ebf33-42dd-4ebe-b06f-646430ccd0bf" released by "delete_volume" :: held 0.821s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a" returned: 0 in 0.315s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:19 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d71e970-b16a-49af-b814-7fcf1c919f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24e80df2-3e3f-4a90-a5af-73bd5910361a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4973feca-ba04-4094-a928-044b1b6e760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Volume volume-24e80df2-3e3f-4a90-a5af-73bd5910361a (24e80df2-3e3f-4a90-a5af-73bd5910361a): created successfully
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4973feca-ba04-4094-a928-044b1b6e760c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Flow 'volume_create_manager' (d5411ce0-204c-43f7-9b73-7c0a1f5058ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['54dfc1b6-32b3-4a1e-a0b0-f8c973bd27ac', '7b7a1c73-4a8f-4337-a78d-a23668b92096', '163164f0-c92c-4749-a3a5-9cf8ead756dd', '36ab216a-04b2-4672-aafe-d3ae4ac95157'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eaf4b812-8cd4-4b0a-bf78-3bf0703c1e4d tempest-CinderUnicodeTest-1173051644 None] Created volume successfully.
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:19 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Creating offline snapshot c8c213a7-fc01-48b0-b01f-152095f35293 of volume 6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:19 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.290s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b118a-6b2a-48d5-8be1-2e74ae5b9e0c]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:19 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-77187610-4380-40f5-a27f-fc499dbdb677 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-826f4bb8-ee29-4e30-8aa7-edbf22c1e888-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:19 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0
Sep 11 23:22:19 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:20 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-297479d7-8c4b-47db-b7bf-ede93db612ce tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-961ebf33-42dd-4ebe-b06f-646430ccd0bf-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:20 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:20 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 1G
Sep 11 23:22:20 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-d895c042-a4ef-4285-af31-18029321228d-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-d895c042-a4ef-4285-af31-18029321228d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-d895c042-a4ef-4285-af31-18029321228d" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-d895c042-a4ef-4285-af31-18029321228d" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[34402e83-1d1c-40b3-998f-fa59533662fe]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:20 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:20 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d
Sep 11 23:22:20 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 1G" returned: 0 in 0.568s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445338c-4da8-490b-aecd-df1a9bcd9338]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:20 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293
Sep 11 23:22:20 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:20 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc
Sep 11 23:22:20 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d" returned: 0 in 0.465s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d
Sep 11 23:22:21 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293" returned: 0 in 0.325s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 is being set with open permissions: ugo+rw
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293
Sep 11 23:22:21 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc
Sep 11 23:22:21 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-d895c042-a4ef-4285-af31-18029321228d" returned: 0 in 0.267s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-d895c042-a4ef-4285-af31-18029321228d" released by "delete_volume" :: held 0.787s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:21 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['507c6cbb-84f1-4823-b8f1-13232d6b2465', 'b7c27a5b-028a-4a54-932e-648938405d9f', '0b3fae4f-5579-438a-8d5c-359ace0287c7', '587c3c59-d973-4c13-80e8-d0f53e45cc00'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info
Sep 11 23:22:21 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:21 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" returned: 0 in 0.303s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc" released by "delete_volume" :: held 0.759s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:21 devstack sudo[106759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:21 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['9e9b2753-f4be-4980-bc91-b9ab40eb24e1', '4abb497d-32cf-4b56-8840-33149a5b8a37', 'f2e5fc57-8ba2-4e17-a378-9eae866501ba', '2fe12554-6e4a-48bb-b276-ab5ad8577a26'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-4785aeb2-35e9-46ed-82a4-4a1df221e2fe-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:21 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:21 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-4785aeb2-35e9-46ed-82a4-4a1df221e2fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:21 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info" returned: 0 in 0.328s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info is being set with open permissions: ugo+rw
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info
Sep 11 23:22:21 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-63454418-337a-4970-a93f-21a4089cdd3f-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe50cfc-7965-4558-a48a-6b1274eb2f98]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-63454418-337a-4970-a93f-21a4089cdd3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-63454418-337a-4970-a93f-21a4089cdd3f" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-63454418-337a-4970-a93f-21a4089cdd3f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleting offline snapshot 63454418-337a-4970-a93f-21a4089cdd3f of volume 51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:21 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] snapshot_file for this snap is: volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa11d6-c0d6-4ddb-a128-6dd21ca09ad3]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5341b314-b572-45a7-9a97-771241cf9489 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-d895c042-a4ef-4285-af31-18029321228d-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:22 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe
Sep 11 23:22:22 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.info" returned: 0 in 0.347s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.332s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.395s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:22 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f
Sep 11 23:22:22 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Creating offline snapshot 017a6429-a1d5-4aed-8362-038e5f062b20 of volume 24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-beb38359-7bef-4f50-acb1-35fd9169a4f1 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-a98c37f1-3790-44a2-bbd0-dfc2fc37d1fc-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-b6b7bf4e-a216-478c-88fd-1f2a54048f35 tempest-ProjectReaderTests-362718808 None] Create snapshot completed successfully
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c72dcd3-b9f3-4eeb-9741-43d7ac94aea9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a
Sep 11 23:22:22 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" returned: 0 in 0.456s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe
Sep 11 23:22:22 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f" returned: 0 in 0.431s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad1f22e-14ec-4a39-a7dc-e1d57b8bddef]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da
Sep 11 23:22:22 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 1G
Sep 11 23:22:22 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" returned: 0 in 0.275s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-4785aeb2-35e9-46ed-82a4-4a1df221e2fe" released by "delete_volume" :: held 0.796s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['5420717d-b824-451a-8177-bad378a44b0f', '93d2696a-019f-41ef-a163-b9ca10354cc7', '03753292-aaf2-40c8-8ece-fdab3e607ca5', '92c07021-2fdf-4a16-9b72-47f8448fb1ef'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:22 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-17d364f0-ec68-47e7-8271-1a4ec6587882-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:22 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da" returned: 0 in 0.490s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-c8c213a7-fc01-48b0-b01f-152095f35293-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:23 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-17d364f0-ec68-47e7-8271-1a4ec6587882-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:23 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-c8c213a7-fc01-48b0-b01f-152095f35293-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-c8c213a7-fc01-48b0-b01f-152095f35293" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-17d364f0-ec68-47e7-8271-1a4ec6587882" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-c8c213a7-fc01-48b0-b01f-152095f35293" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Deleting offline snapshot c8c213a7-fc01-48b0-b01f-152095f35293 of volume 6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] snapshot_file for this snap is: volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:23 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-17d364f0-ec68-47e7-8271-1a4ec6587882" acquired by "delete_volume" :: waited 0.067s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[586090c7-5e5e-41b3-8734-7ac64240f077]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 1G" returned: 0 in 0.597s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[697af298-3be3-4ff9-a849-f26e7f196257]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e80df2-3e3f-4a90-a5af-73bd5910361a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.435s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:23 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e80df2-3e3f-4a90-a5af-73bd5910361a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20
Sep 11 23:22:23 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-20374008-b6d6-43fb-8c27-f80f0412555e tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-4785aeb2-35e9-46ed-82a4-4a1df221e2fe-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:23 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293
Sep 11 23:22:23 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882
Sep 11 23:22:23 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f
Sep 11 23:22:23 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24e80df2-3e3f-4a90-a5af-73bd5910361a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20" returned: 0 in 0.352s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 is being set with open permissions: ugo+rw
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20
Sep 11 23:22:23 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293" returned: 0 in 0.441s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:23 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882" returned: 0 in 0.440s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305a2dc-7dda-422a-af46-14b5bcab74b9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882
Sep 11 23:22:23 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da.63454418-337a-4970-a93f-21a4089cdd3f" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack sudo[106829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-63454418-337a-4970-a93f-21a4089cdd3f" released by "_delete_snapshot" :: held 1.816s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:23 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" released by "delete_snapshot" :: held 1.844s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:23 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20" returned: 0 in 0.297s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['4d4841a2-b482-4e45-8873-9141518da73f', '61de2b30-c06f-4425-b4c2-30a82576ea93', '76f5d6e1-bfa2-4d47-be27-b2192d7c0dae', '25b3404e-5fa2-4447-891d-9fd40c76a1a3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:23 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info
Sep 11 23:22:23 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:23 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-17d364f0-ec68-47e7-8271-1a4ec6587882" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Delete snapshot completed successfully.
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-17d364f0-ec68-47e7-8271-1a4ec6587882" released by "delete_volume" :: held 0.814s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-76fb2ef9-23c0-44e4-86cc-4a39699a77b0 tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-63454418-337a-4970-a93f-21a4089cdd3f-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['c2f7c87e-cb97-4b50-9d37-0ebcac973091', '229cfb84-eac2-4952-8da2-f9d9e491c1ec', 'e2ebe4c9-0029-4a3c-9ac8-0eefca5d462e', '8cdb5609-9970-49b5-8901-41707033939d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:24 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" returned: 0 in 0.410s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293
Sep 11 23:22:24 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-51188bd1-c0a6-4533-ba0a-3cd5909db2da-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-51188bd1-c0a6-4533-ba0a-3cd5909db2da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:24 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:24 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info" returned: 0 in 0.350s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info is being set with open permissions: ugo+rw
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:24 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info
Sep 11 23:22:24 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-41a81b30-14b2-449b-92f2-afa43b486b29-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" acquired by "delete_volume" :: waited 0.047s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecc9836-3f9e-4398-af17-6467f146e4ef]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-41a81b30-14b2-449b-92f2-afa43b486b29-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-41a81b30-14b2-449b-92f2-afa43b486b29" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-41a81b30-14b2-449b-92f2-afa43b486b29" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592a341-2c43-46fb-ac94-24c1710f380e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da
Sep 11 23:22:24 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293" returned: 0 in 0.481s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.429s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:24 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293
Sep 11 23:22:24 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-54262c2b-3dfa-4473-98cb-ce77e4e1b9ca tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-17d364f0-ec68-47e7-8271-1a4ec6587882-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:24 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29
Sep 11 23:22:24 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.info" returned: 0 in 0.418s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6a052f38-2b07-4c17-b93b-290243cd97ad tempest-CinderUnicodeTest-1173051644 None] Create snapshot completed successfully
Sep 11 23:22:24 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da" returned: 0 in 0.455s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da
Sep 11 23:22:24 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0.c8c213a7-fc01-48b0-b01f-152095f35293" returned: 0 in 0.342s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29" returned: 0 in 0.431s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-c8c213a7-fc01-48b0-b01f-152095f35293" released by "_delete_snapshot" :: held 1.827s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-017a6429-a1d5-4aed-8362-038e5f062b20-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:24 devstack sudo[106868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29
Sep 11 23:22:24 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" released by "delete_snapshot" :: held 1.897s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-017a6429-a1d5-4aed-8362-038e5f062b20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-quobyte-017a6429-a1d5-4aed-8362-038e5f062b20" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-017a6429-a1d5-4aed-8362-038e5f062b20" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Deleting offline snapshot 017a6429-a1d5-4aed-8362-038e5f062b20 of volume 24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] snapshot_file for this snap is: volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc067ca1-ec9b-4094-b630-5ee47ac03b29]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:25 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Created reservations ['e394045f-6f62-4ffa-a732-0c84fe7e1da2', '86061433-d990-41f5-8a90-106dcf76a230', '4383420f-2e4e-4843-b87e-6f9b98ea7ca3', 'bd1c1fd3-239f-4c81-9167-0665465e8633'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-51188bd1-c0a6-4533-ba0a-3cd5909db2da" returned: 0 in 0.332s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-quobyte-51188bd1-c0a6-4533-ba0a-3cd5909db2da" released by "delete_volume" :: held 0.897s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack sudo[106877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20
Sep 11 23:22:25 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:25 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-41a81b30-14b2-449b-92f2-afa43b486b29" returned: 0 in 0.363s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-41a81b30-14b2-449b-92f2-afa43b486b29" released by "delete_volume" :: held 0.844s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Delete snapshot completed successfully.
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-962df317-e111-4682-955e-a7268f8c0cc4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-c8c213a7-fc01-48b0-b01f-152095f35293-delete_snapshot" released by "delete_snapshot" :: held 2.305s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Created reservations ['e7e76fdf-1c98-4168-ad6f-4bf4c1029bce', 'b7faa0c8-bc8f-4aaa-bab1-c53aa64273f9', 'f0017417-87b5-4107-82a0-7128131222d6', '654551d1-2835-4c1f-b461-5ac96edd8146'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['0a955a40-9b6c-47d1-85f1-d1c65cedc91b', '8721c223-828b-4006-8950-251bed84e3c5', 'b7f61648-c32b-425e-a3e1-823fa16a38c7', 'c7bd2024-2dc9-4b36-9507-0d016ca7b9f8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:25 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:25 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:25 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:25 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:25 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20" returned: 0 in 0.429s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24e80df2-3e3f-4a90-a5af-73bd5910361a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f340060-4a0b-454a-8289-2b27605e03ea]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:25 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a
Sep 11 23:22:25 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:25 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Deleted volume successfully.
Sep 11 23:22:25 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-70d5273a-d276-4e19-a5ad-33f52f509a8d tempest-CreateVolumesFromSnapshotTest-1955827406 None] Lock "cinder-51188bd1-c0a6-4533-ba0a-3cd5909db2da-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1cb95a77-e001-4bad-8837-16eaf2cdbd95 tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-41a81b30-14b2-449b-92f2-afa43b486b29-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:25 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a" returned: 0 in 0.371s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:26 devstack sudo[106895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20
Sep 11 23:22:26 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "cinder-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa3ea72-4d7a-4768-bbe9-aedbc44caec1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:26 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20" returned: 0 in 0.384s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:26 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20
Sep 11 23:22:26 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:26 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0
Sep 11 23:22:26 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-f0433637-8244-4de9-96ea-1a97cdefe6b1-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-f0433637-8244-4de9-96ea-1a97cdefe6b1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "cinder-quobyte-f0433637-8244-4de9-96ea-1a97cdefe6b1" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:26 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a.017a6429-a1d5-4aed-8362-038e5f062b20" returned: 0 in 0.300s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-f0433637-8244-4de9-96ea-1a97cdefe6b1" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2d47ca-ae2f-48cb-ab33-cd9fa898c42d]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-017a6429-a1d5-4aed-8362-038e5f062b20" released by "_delete_snapshot" :: held 1.658s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" released by "delete_snapshot" :: held 1.701s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:26 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" returned: 0 in 0.461s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Created reservations ['fc06c0f4-1954-45d6-8d5d-9b3d06e0ce47', '0cda12a6-4278-4bc8-a84d-e9fa19a0b2ef', 'c2b9ba4c-99d0-46e6-b551-f8d7a37e0188', '588aa5ae-da89-4f7f-ab3c-875a5b5d23f8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:26 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0
Sep 11 23:22:26 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:26 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1
Sep 11 23:22:26 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Delete snapshot completed successfully.
Sep 11 23:22:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3be72252-0237-4789-a920-2f9824269b9d tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-017a6429-a1d5-4aed-8362-038e5f062b20-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:27 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0" released by "delete_volume" :: held 0.811s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:27 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-24e80df2-3e3f-4a90-a5af-73bd5910361a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1" returned: 0 in 0.443s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:27 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1
Sep 11 23:22:27 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-24e80df2-3e3f-4a90-a5af-73bd5910361a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Created reservations ['00aee9f6-6e89-45fe-a4c5-da21782b0649', '519e8697-008b-4416-9718-b9ebdcb75587', '023de4d9-cc81-4607-a44f-efa6047b8bd6', '21f2a067-a043-4474-a38b-9d3b0ca9cfa7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" acquired by "delete_volume" :: waited 0.037s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8bb05f-b825-43f1-b49c-5e4a97d630d9]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:27 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:27 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:27 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f0433637-8244-4de9-96ea-1a97cdefe6b1" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:27 devstack sudo[106919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a
Sep 11 23:22:27 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-quobyte-f0433637-8244-4de9-96ea-1a97cdefe6b1" released by "delete_volume" :: held 0.902s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Created reservations ['c9fe2582-5027-4c68-9f8e-df0caed3b2ff', 'd0ddd761-9b1d-4b4f-9ea9-38558c84364f', '75ddb832-ca23-4172-84b7-fbbadf81ae82', 'ac7b1589-f422-418f-b357-1174e2da21c7'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:27 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a" returned: 0 in 0.514s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:27 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:27 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:27 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.477s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:27 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:27 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Deleted volume successfully.
Sep 11 23:22:27 devstack sudo[106929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a
Sep 11 23:22:27 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a763b4d1-da30-4ca9-bb5d-eddb036b9d1e tempest-ProjectReaderTests-362718808 None] Lock "cinder-6013d3fe-7abb-435e-9e0d-bf2ba01ec7b0-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (4635e2a8-9d8b-4866-a2f8-5ca24ed257c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb5f9c2-350c-43b1-9fea-488266da22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bb5f9c2-350c-43b1-9fea-488266da22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858478642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8684dde6-6dde-4e41-875a-62377b634081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:28Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7930f766-2edd-4559-9996-31efeebbf0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7930f766-2edd-4559-9996-31efeebbf0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68684beb-bc68-46a7-909d-d1570b9899b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68684beb-bc68-46a7-909d-d1570b9899b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8684dde6-6dde-4e41-875a-62377b634081', 'volume_name': 'volume-8684dde6-6dde-4e41-875a-62377b634081', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858f0269-9202-47f4-805f-f3d063d1b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858f0269-9202-47f4-805f-f3d063d1b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c1bf1-986e-4637-a124-2a9688acce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Volume 8684dde6-6dde-4e41-875a-62377b634081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8684dde6-6dde-4e41-875a-62377b634081', 'volume_size': 1}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1858478642',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8684dde6-6dde-4e41-875a-62377b634081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:28Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Creating volume 8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:28 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:28 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.451s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Deleted volume successfully.
Sep 11 23:22:28 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 1073741824
Sep 11 23:22:28 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:28 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fa8c822-92af-4d07-b56d-fe0db28c5e2a tempest-CreateVolumesFromSourceVolumeTest-347745669 None] Lock "cinder-f0433637-8244-4de9-96ea-1a97cdefe6b1-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-24e80df2-3e3f-4a90-a5af-73bd5910361a" returned: 0 in 0.454s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-24e80df2-3e3f-4a90-a5af-73bd5910361a" released by "delete_volume" :: held 1.068s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Created reservations ['e34a7de4-398e-436d-9132-2011ad019b72', 'a2b4266c-ce2c-4f38-b5d9-1aa9acdc4cbf', 'bc3cc52f-d189-4121-b1bc-a0c752051267', '9d7df288-69ef-498e-8b67-1053d6ed3885'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:28 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:28 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:28 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.261s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:28 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Deleted volume successfully.
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 1073741824" returned: 0 in 0.494s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-5cc31f72-f34a-4d8e-9125-00695ad1b7bd tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-24e80df2-3e3f-4a90-a5af-73bd5910361a-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:28 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081
Sep 11 23:22:28 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:29 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081" returned: 0 in 0.263s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1c1bf1-986e-4637-a124-2a9688acce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8684dde6-6dde-4e41-875a-62377b634081', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85082c7-37d9-4e1e-8f45-175f42e4a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:29 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Volume volume-8684dde6-6dde-4e41-875a-62377b634081 (8684dde6-6dde-4e41-875a-62377b634081): created successfully
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e85082c7-37d9-4e1e-8f45-175f42e4a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (4635e2a8-9d8b-4866-a2f8-5ca24ed257c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-10101bc3-ee67-419f-8ba7-79fbb5788d2d tempest-ProjectReaderTests-362718808 None] Created volume successfully.
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-1917f78c-69a5-40d3-b561-003537b927f7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-1917f78c-69a5-40d3-b561-003537b927f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "cinder-quobyte-1917f78c-69a5-40d3-b561-003537b927f7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-1917f78c-69a5-40d3-b561-003537b927f7" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[02578b76-4ea2-4600-a3b4-b272856b9310]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:29 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7
Sep 11 23:22:29 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:30 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7" returned: 0 in 0.428s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:30 devstack sudo[106952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7
Sep 11 23:22:30 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:30 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-1917f78c-69a5-40d3-b561-003537b927f7" returned: 0 in 0.297s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-quobyte-1917f78c-69a5-40d3-b561-003537b927f7" released by "delete_volume" :: held 0.777s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Created reservations ['6dc0a3d1-24c7-41e0-a6e6-747f4edd0f6b', 'acf2500c-f44c-4223-b29e-3c0fec18617c', '739beea1-86f5-4a71-a008-13e94bb58b89', '31b29e3e-e6ac-463d-8519-a0a3ee8dfdf6'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Creating offline snapshot ae492d30-3421-4ff6-bc50-8892c482e732 of volume 8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[77149c63-0bf8-46df-b759-0d5f2d4ca6f5]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:30 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:30 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:30 devstack sudo[106955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081
Sep 11 23:22:30 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:30 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.324s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Deleted volume successfully.
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-742b8d86-dfb6-47cb-92a0-fa5abba77bfb tempest-CinderUnicodeTest-1173051644 None] Lock "cinder-1917f78c-69a5-40d3-b561-003537b927f7-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:30 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081" returned: 0 in 0.461s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:31 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 1G
Sep 11 23:22:31 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:31 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 1G" returned: 0 in 0.477s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8684dde6-6dde-4e41-875a-62377b634081 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:31 devstack sudo[106969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8684dde6-6dde-4e41-875a-62377b634081 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732
Sep 11 23:22:31 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:31 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8684dde6-6dde-4e41-875a-62377b634081 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:31 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 is being set with open permissions: ugo+rw
Sep 11 23:22:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:31 devstack sudo[106974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732
Sep 11 23:22:31 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:32 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732" returned: 0 in 0.264s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:32 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info
Sep 11 23:22:32 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:32 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info" returned: 0 in 0.398s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:32 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info is being set with open permissions: ugo+rw
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:32 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info
Sep 11 23:22:32 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:32 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.info" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0f482fea-7837-43a7-b280-9b0a9866bb4b tempest-ProjectReaderTests-362718808 None] Create snapshot completed successfully
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-ae492d30-3421-4ff6-bc50-8892c482e732-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-ae492d30-3421-4ff6-bc50-8892c482e732-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-ae492d30-3421-4ff6-bc50-8892c482e732" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-ae492d30-3421-4ff6-bc50-8892c482e732" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Deleting offline snapshot ae492d30-3421-4ff6-bc50-8892c482e732 of volume 8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] snapshot_file for this snap is: volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[26de162c-1a63-4110-a249-4305c7873d37]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:34 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732
Sep 11 23:22:34 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:34 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732" returned: 0 in 0.538s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8684dde6-6dde-4e41-875a-62377b634081(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Flow 'volume_create_manager' (2434a1eb-10e2-414a-b16e-633d3d8ea7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880da084-0545-4547-8a71-65cc4d4488cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc16df-b708-4af5-ab77-a2811c862beb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880da084-0545-4547-8a71-65cc4d4488cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ef103-1363-4bfd-a5a0-b4f80f8fd526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac58916b6ca40c88355fa65d3524a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:34Z,use_quota=True,user_id='8039e8993bb9494ba2b585316ee904bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a1bef8-74ff-41bc-90bd-2fe538a67643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a1bef8-74ff-41bc-90bd-2fe538a67643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1cf5a5-1c21-4148-b4b3-1555dbfcdcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:34 devstack cinder-volume[88022]: DEBUG cinder.image.glance [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Creating Keystone auth plugin from conf {{(pid=88022) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 11 23:22:34 devstack sudo[106989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081
Sep 11 23:22:34 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:35 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081" returned: 0 in 0.547s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:35 devstack sudo[106994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732
Sep 11 23:22:35 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1cf5a5-1c21-4148-b4b3-1555dbfcdcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d7ef103-1363-4bfd-a5a0-b4f80f8fd526', 'volume_name': 'volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526', 'volume_size': 1, 'image_id': '13199608-ea6f-445f-97cb-02de79dd51db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7569388da2b246faf016f29c2b1713', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ac58916b6ca40c88355fa65d3524a5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a996de7c2a04eb97c080a3f6d85f8d4ef1ab1a154ade2dc5cccaf121bbfd39126818bb08cce3ddbec580e8ae0aa92dc42158661d4f82d837b7b5fb5965b5921', 'id': '13199608-ea6f-445f-97cb-02de79dd51db', 'created_at': datetime.datetime(2026, 9, 11, 21, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13199608-ea6f-445f-97cb-02de79dd51db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6240fe0>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8fd89d-738b-48b2-a29b-a90b8c5684d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8fd89d-738b-48b2-a29b-a90b8c5684d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768f9d55-10d8-42e4-9c77-bd41a8cf3fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:35 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526', 'volume_size': 1, 'image_id': '13199608-ea6f-445f-97cb-02de79dd51db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7569388da2b246faf016f29c2b1713', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ac58916b6ca40c88355fa65d3524a5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a996de7c2a04eb97c080a3f6d85f8d4ef1ab1a154ade2dc5cccaf121bbfd39126818bb08cce3ddbec580e8ae0aa92dc42158661d4f82d837b7b5fb5965b5921', 'id': '13199608-ea6f-445f-97cb-02de79dd51db', 'created_at': datetime.datetime(2026, 9, 11, 21, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13199608-ea6f-445f-97cb-02de79dd51db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6240fe0>}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Trying to clone 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 from image 13199608-ea6f-445f-97cb-02de79dd51db at location (None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}]). {{(pid=88022) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Sep 11 23:22:35 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Image download 0.00 MB at 0.00 MB/s
Sep 11 23:22:35 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732" returned: 0 in 0.560s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf23eb-619e-4ba9-9b62-5b96d14b3cfe]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:35 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732
Sep 11 23:22:35 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:35 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:35 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:35 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081.ae492d30-3421-4ff6-bc50-8892c482e732" returned: 0 in 0.284s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-ae492d30-3421-4ff6-bc50-8892c482e732" released by "_delete_snapshot" :: held 2.103s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" released by "delete_snapshot" :: held 2.147s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:35 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-f3dbf592-9c20-4cb1-972b-66582f2a3f1f tempest-ProjectAdminTests-1710379075 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.1954460144043, 'free_capacity_gb': 1773.1954460144043, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88022) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Created reservations ['28ef4766-4f5b-40b5-9f5d-7cf2ba46698e', '5cd1e764-bfdb-4842-8ad3-a423cbb9f863', '24ca5be1-fd69-41a8-931c-36414b8706a5', '039cfc86-df2d-4798-884e-32db356c6ab1'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:36 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=327,cinder:SELECT=244,cinder:INSERT=83,cinder:DELETE=23 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:22:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Delete snapshot completed successfully.
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbb9d4f8-5511-41db-8e6e-33286e4ef84c tempest-ProjectReaderTests-362718808 None] Lock "cinder-ae492d30-3421-4ff6-bc50-8892c482e732-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:36 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:36 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:36 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Temporary image 13199608-ea6f-445f-97cb-02de79dd51db is fetched for user 8039e8993bb9494ba2b585316ee904bb. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=239,cinder:UPDATE=332,cinder:INSERT=88,cinder:DELETE=35 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03839d7-8700-4cab-afda-6334deb951c7]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:36 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:36 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:36 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-8684dde6-6dde-4e41-875a-62377b634081-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-8684dde6-6dde-4e41-875a-62377b634081-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:37 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:37 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" acquired by "delete_volume" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[19516ff6-0025-4e7f-8377-845981c366d8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:37 devstack sudo[107018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081
Sep 11 23:22:37 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:37 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d7ef103-1363-4bfd-a5a0-b4f80f8fd526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ac58916b6ca40c88355fa65d3524a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:34Z,use_quota=True,user_id='8039e8993bb9494ba2b585316ee904bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Creating volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:37 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:37 devstack sudo[107023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1073741824
Sep 11 23:22:37 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:37 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:37 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081
Sep 11 23:22:37 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:37 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8684dde6-6dde-4e41-875a-62377b634081" returned: 0 in 0.319s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1073741824" returned: 0 in 0.578s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:37 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-8684dde6-6dde-4e41-875a-62377b634081" released by "delete_volume" :: held 0.852s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:38 devstack sudo[107037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Created reservations ['ff35b938-f6f4-44f1-afce-8ef3851020e8', 'd24d9edb-a695-4376-8b66-fe73880c99c2', 'b197416d-12fa-409b-85bc-45dd2f7e0cf0', 'fcac6129-336b-44fc-9a9c-ccdf190dc39a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:38 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:38 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:38 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:38 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" returned: 0 in 0.336s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Attempting download of 13199608-ea6f-445f-97cb-02de79dd51db ((None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}])) to volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f948db-75e5-4f3d-9487-86cc787f0597]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:38 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Deleted volume successfully.
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c2580e32-68c1-4162-9242-a68772a283a4 tempest-ProjectReaderTests-362718808 None] Lock "cinder-8684dde6-6dde-4e41-875a-62377b634081-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:38 devstack sudo[107043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa
Sep 11 23:22:38 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:38 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa" returned: 0 in 0.442s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:38 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (a6574576-cc4c-4d78-9f98-470fc5bed3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe8df0a-eeb7-4c81-a82b-7082271740d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe8df0a-eeb7-4c81-a82b-7082271740d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367745179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:39Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134c3b20-31af-42c8-a7fb-646962596646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (134c3b20-31af-42c8-a7fb-646962596646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed784233-b3ba-471b-abc6-7ae70b4e01b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed784233-b3ba-471b-abc6-7ae70b4e01b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd', 'volume_name': 'volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab23910e-32c1-42ca-829e-747924f60724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab23910e-32c1-42ca-829e-747924f60724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398a0dd-f555-4352-85df-11f81f09d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:39 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Volume 93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd', 'volume_size': 1}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1367745179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5bfd3802f6534d58b3cc424aa3c7d2cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:39Z,use_quota=True,user_id='b3f808be9b914163b9b7ec793acb90c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Creating volume 93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:39 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa
Sep 11 23:22:39 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:39 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:39 devstack sudo[107050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd 1073741824
Sep 11 23:22:39 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:39 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa" returned: 1 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13199608-ea6f-445f-97cb-02de79dd51db_tnov1ffa' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342320b-a6bd-4f88-b6d5-32c8fc3bbfe9]: (4, 'raw') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:39 devstack sudo[107056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:39 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:39 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd 1073741824" returned: 0 in 0.575s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:39 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:39 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd
Sep 11 23:22:39 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:39 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD
Sep 11 23:22:39 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:40 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" returned: 0 in 0.353s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0398a0dd-f555-4352-85df-11f81f09d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a8fe8-5e07-4fd6-87ef-a1a62d990892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Volume volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd (93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd): created successfully
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a8fe8-5e07-4fd6-87ef-a1a62d990892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Flow 'volume_create_manager' (a6574576-cc4c-4d78-9f98-470fc5bed3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] 13199608-ea6f-445f-97cb-02de79dd51db was raw, converting to qcow2 {{(pid=88022) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:40 devstack sudo[107070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526
Sep 11 23:22:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-578e366a-ae76-41eb-a8c5-76964b7c4c4b tempest-ProjectReaderTests-362718808 None] Created volume successfully.
Sep 11 23:22:40 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (2ad5a42c-4062-4205-b35b-059aa859dffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7802b159-47a0-4a43-84f1-fdb12e02546b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7802b159-47a0-4a43-84f1-fdb12e02546b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563831575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da41197-a53c-4847-abb0-052186b0661e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:40Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084b9fc5-329e-40e2-a4a7-cd98188eefd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084b9fc5-329e-40e2-a4a7-cd98188eefd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7893255-057b-4c9e-9a74-81e0278c3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7893255-057b-4c9e-9a74-81e0278c3154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4da41197-a53c-4847-abb0-052186b0661e', 'volume_name': 'volume-4da41197-a53c-4847-abb0-052186b0661e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409d1937-67e2-4440-9c9e-5a533badf25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409d1937-67e2-4440-9c9e-5a533badf25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3871eb0-698b-48d5-977f-d20efd68132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:40 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Volume 4da41197-a53c-4847-abb0-052186b0661e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4da41197-a53c-4847-abb0-052186b0661e', 'volume_size': 1}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-563831575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4da41197-a53c-4847-abb0-052186b0661e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:40Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Creating volume 4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:40 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:40 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e 1073741824
Sep 11 23:22:40 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:40 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" returned: 0 in 0.471s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13199608-ea6f-445f-97cb-02de79dd51db_dh8yedosdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:22:40 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Converted 0.00 MB image at 0.00 MB/s
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:40 devstack sudo[107081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1G
Sep 11 23:22:40 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:40 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e 1073741824" returned: 0 in 0.509s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:40 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e
Sep 11 23:22:40 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:41 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 1G" returned: 0 in 0.373s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Downloaded image 13199608-ea6f-445f-97cb-02de79dd51db ((None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}])) to volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 successfully. {{(pid=88022) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Temporary image 13199608-ea6f-445f-97cb-02de79dd51db for user 8039e8993bb9494ba2b585316ee904bb is deleted. {{(pid=88022) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.volume_utils [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Marking volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 as bootable. {{(pid=88022) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Copying metadata from image 13199608-ea6f-445f-97cb-02de79dd51db to 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526. {{(pid=88022) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Creating volume glance metadata for volume 5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 backed by image 13199608-ea6f-445f-97cb-02de79dd51db with: {'image_id': '13199608-ea6f-445f-97cb-02de79dd51db', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '3f7569388da2b246faf016f29c2b1713', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88022) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768f9d55-10d8-42e4-9c77-bd41a8cf3fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526', 'volume_size': 1, 'image_id': '13199608-ea6f-445f-97cb-02de79dd51db', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13199608-ea6f-445f-97cb-02de79dd51db', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f7569388da2b246faf016f29c2b1713', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ac58916b6ca40c88355fa65d3524a5e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a996de7c2a04eb97c080a3f6d85f8d4ef1ab1a154ade2dc5cccaf121bbfd39126818bb08cce3ddbec580e8ae0aa92dc42158661d4f82d837b7b5fb5965b5921', 'id': '13199608-ea6f-445f-97cb-02de79dd51db', 'created_at': datetime.datetime(2026, 9, 11, 21, 22, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 11, 21, 22, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13199608-ea6f-445f-97cb-02de79dd51db/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x72bdb6240fe0>}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b9d07-859c-4cb3-babd-7959562db657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Volume volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 (5d7ef103-1363-4bfd-a5a0-b4f80f8fd526): created successfully
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892b9d07-859c-4cb3-babd-7959562db657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Flow 'volume_create_manager' (2434a1eb-10e2-414a-b16e-633d3d8ea7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4ed040a1-f528-447b-a7c7-9a8481d63c5a tempest-VolumeImageDependencyTests-960151186 None] Created volume successfully.
Sep 11 23:22:41 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e" returned: 0 in 0.299s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3871eb0-698b-48d5-977f-d20efd68132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4da41197-a53c-4847-abb0-052186b0661e', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51474a-4405-4da7-8af7-991b55402196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Volume volume-4da41197-a53c-4847-abb0-052186b0661e (4da41197-a53c-4847-abb0-052186b0661e): created successfully
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51474a-4405-4da7-8af7-991b55402196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (2ad5a42c-4062-4205-b35b-059aa859dffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-07161b71-3aac-44e9-99e6-109a51706b59 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Creating offline snapshot 74a34578-98b5-495f-8054-50c7c4def397 of volume 93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebd4cc-7416-44c6-b389-165509911085]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:41 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd
Sep 11 23:22:41 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:41 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:41 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 1G
Sep 11 23:22:41 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Acquiring lock "cinder-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "cinder-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Acquiring lock "cinder-quobyte-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "cinder-quobyte-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749025b-cf8c-446a-b4e6-5ca55f024f52]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:42 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 1G" returned: 0 in 0.460s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:42 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526
Sep 11 23:22:42 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:42 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397
Sep 11 23:22:42 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:42 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:42 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" returned: 0 in 0.468s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:42 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 is being set with open permissions: ugo+rw
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:42 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526
Sep 11 23:22:42 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:42 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397
Sep 11 23:22:42 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:42 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" returned: 0 in 0.339s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "cinder-quobyte-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526" released by "delete_volume" :: held 0.856s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:42 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:42 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info
Sep 11 23:22:42 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:42 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Created reservations ['772373b1-398b-4d3f-b00d-5230e29e6d0a', '54d07d32-36c4-44f4-a3da-06f296af4cc6', '27030e54-4d22-4ae6-bde0-f55a931b892a', '5f9ba1e2-f2f5-4549-a7fb-77aade356c8e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:43 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:43 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:43 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info" returned: 0 in 0.310s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:43 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info is being set with open permissions: ugo+rw
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:43 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info
Sep 11 23:22:43 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:43 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Deleted volume successfully.
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-3beb513c-d46a-4754-b159-73d5bbd3ea42 tempest-VolumeImageDependencyTests-960151186 None] Lock "cinder-5d7ef103-1363-4bfd-a5a0-b4f80f8fd526-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:43 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.info" returned: 0 in 0.283s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.677s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Creating offline snapshot d0e1aeef-489d-46ad-9c5d-29168186d774 of volume 4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd57c6e6-7844-4f1d-853e-5c51d1cf9635]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:43 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-07e32ef4-b86f-47ff-a9a3-25f08e8fd98a tempest-ProjectReaderTests-362718808 None] Create snapshot completed successfully
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:43 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e
Sep 11 23:22:43 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:43 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e" returned: 0 in 0.373s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:43 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:43 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 1G
Sep 11 23:22:43 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:44 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 1G" returned: 0 in 0.497s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da41197-a53c-4847-abb0-052186b0661e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:44 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da41197-a53c-4847-abb0-052186b0661e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774
Sep 11 23:22:44 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-74a34578-98b5-495f-8054-50c7c4def397-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-74a34578-98b5-495f-8054-50c7c4def397-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-74a34578-98b5-495f-8054-50c7c4def397" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-74a34578-98b5-495f-8054-50c7c4def397" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Deleting offline snapshot 74a34578-98b5-495f-8054-50c7c4def397 of volume 93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] snapshot_file for this snap is: volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[34574cd3-5124-49b7-a582-715afdb86387]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:44 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397
Sep 11 23:22:44 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:44 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4da41197-a53c-4847-abb0-052186b0661e -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774" returned: 0 in 0.440s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:44 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 is being set with open permissions: ugo+rw
Sep 11 23:22:44 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:44 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774
Sep 11 23:22:44 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:45 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397" returned: 0 in 0.514s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb825c-b90a-4799-81bb-3839a92b9f90]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:45 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774" returned: 0 in 0.305s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:45 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info
Sep 11 23:22:45 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:45 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd
Sep 11 23:22:45 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:45 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:45 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info is being set with open permissions: ugo+rw
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:45 devstack sudo[107164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info
Sep 11 23:22:45 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:45 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:45 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397
Sep 11 23:22:45 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:45 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.info" returned: 0 in 0.317s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:45 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:45 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fff846e8-7335-4cc1-874a-5ffb589425cc tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-d0e1aeef-489d-46ad-9c5d-29168186d774-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-d0e1aeef-489d-46ad-9c5d-29168186d774-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-d0e1aeef-489d-46ad-9c5d-29168186d774" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:46 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:46 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-d0e1aeef-489d-46ad-9c5d-29168186d774" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot d0e1aeef-489d-46ad-9c5d-29168186d774 of volume 4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:46 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397" returned: 0 in 0.532s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ca131-b349-497a-8d5f-95bb0f473a38]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:46 devstack sudo[107176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397
Sep 11 23:22:46 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:46 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774
Sep 11 23:22:46 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:46 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:22:46 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd.74a34578-98b5-495f-8054-50c7c4def397" returned: 0 in 0.351s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-74a34578-98b5-495f-8054-50c7c4def397" released by "_delete_snapshot" :: held 1.982s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" released by "delete_snapshot" :: held 2.015s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Created reservations ['7d1e229e-4851-4b03-82aa-c8681346d700', '693d1136-ecd0-4f4c-a568-0433fdc00517', 'd3e7f6cb-88e6-45a4-9b78-66c42608520f', '469b5327-cbd0-4a68-9ebc-589c54512403'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:46 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774" returned: 0 in 0.539s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4da41197-a53c-4847-abb0-052186b0661e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa33e36-54bc-4aca-8aa8-7e328772d6c4]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:46 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Delete snapshot completed successfully.
Sep 11 23:22:46 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-36ccf680-0b25-4b9f-8821-53b8437c0104 tempest-ProjectReaderTests-362718808 None] Lock "cinder-74a34578-98b5-495f-8054-50c7c4def397-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:46 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e
Sep 11 23:22:46 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:47 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e" returned: 0 in 0.406s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:47 devstack sudo[107191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774
Sep 11 23:22:47 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:47 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774" returned: 0 in 0.338s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:47 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774
Sep 11 23:22:47 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "cinder-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:47 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e.d0e1aeef-489d-46ad-9c5d-29168186d774" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-d0e1aeef-489d-46ad-9c5d-29168186d774" released by "_delete_snapshot" :: held 1.743s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Acquiring lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" released by "delete_snapshot" :: held 1.781s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfe0c8b-45d1-415a-9e5f-ee64d6964dcb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:47 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Created reservations ['1167de4d-c95e-4038-8cc5-21ed836ed873', '4f18b645-8e12-4384-b778-816a57b5b2f6', '68abca20-9edf-4039-b91d-2b9fa24c326a', '671f74e1-0a6f-4958-a7ac-6a8389452ec1'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:48 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:22:48 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd
Sep 11 23:22:48 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c1040b3a-0337-42fc-afd9-82eee5945232 tempest-ProjectMemberTests-300268079 None] Lock "cinder-d0e1aeef-489d-46ad-9c5d-29168186d774-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-4da41197-a53c-4847-abb0-052186b0661e-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "cinder-4da41197-a53c-4847-abb0-052186b0661e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd4a8d1-ffec-4841-9350-3190792a6a81]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:48 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" returned: 0 in 0.423s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:48 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd
Sep 11 23:22:48 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:48 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e
Sep 11 23:22:48 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:48 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" returned: 0 in 0.273s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "cinder-quobyte-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd" released by "delete_volume" :: held 0.759s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Created reservations ['ec03e8e0-6df2-4024-ab31-9d074200e192', '92bb3551-913d-49ae-af70-347f04166095', '28d24eb4-513d-4e12-8a26-b64e9422ebd1', '03e916d7-6383-4136-a190-fea011ab8e86'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:48 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:48 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e
Sep 11 23:22:48 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:48 devstack sudo[107215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:48 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:49 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-4da41197-a53c-4847-abb0-052186b0661e" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-4da41197-a53c-4847-abb0-052186b0661e" released by "delete_volume" :: held 0.742s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:49 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.299s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Deleted volume successfully.
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Created reservations ['f12d82c9-2320-43c9-b809-1d4f71cd10fb', '053cc57d-a36c-4435-b6d4-76c5df82355c', 'e9d37ecb-1ffb-49ac-8d80-7640991a7efd', 'b6d911fa-69c8-4f30-81fe-578e2daea7a8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fc0d2524-2a2d-4789-83fd-00577115bb3a tempest-ProjectReaderTests-362718808 None] Lock "cinder-93d8fd3d-a9d3-4c83-8d6e-2f7d0dffb7cd-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:49 devstack sudo[107219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:49 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:49 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.286s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:49 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:22:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-915c7a6e-ac5e-4e6b-abc4-89ee431936db tempest-ProjectMemberTests-300268079 None] Lock "cinder-4da41197-a53c-4847-abb0-052186b0661e-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (71c1ebca-b819-4e84-a9fd-901c6727253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47763fd0-6a39-45c9-a0ca-f79da04805e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47763fd0-6a39-45c9-a0ca-f79da04805e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052572478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06502757-10d6-474a-9acf-509193010d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:50Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abc65bc-ce4a-4b0e-9642-596b04e93f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abc65bc-ce4a-4b0e-9642-596b04e93f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe445f78-2696-4fd0-86b2-6ad1adfbe48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe445f78-2696-4fd0-86b2-6ad1adfbe48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06502757-10d6-474a-9acf-509193010d65', 'volume_name': 'volume-06502757-10d6-474a-9acf-509193010d65', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0a9ce6-9209-4ef7-9970-d77f5ba2df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0a9ce6-9209-4ef7-9970-d77f5ba2df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd7b792-e514-4186-b103-6e925b2c738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:50 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Volume 06502757-10d6-474a-9acf-509193010d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06502757-10d6-474a-9acf-509193010d65', 'volume_size': 1}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052572478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06502757-10d6-474a-9acf-509193010d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:50Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Creating volume 06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:50 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:50 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 1073741824
Sep 11 23:22:50 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:50 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 1073741824" returned: 0 in 0.548s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:50 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65
Sep 11 23:22:50 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:51 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65" returned: 0 in 0.294s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd7b792-e514-4186-b103-6e925b2c738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06502757-10d6-474a-9acf-509193010d65', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cc9271-5873-4ac6-b79e-e456ac5aeae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:51 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Volume volume-06502757-10d6-474a-9acf-509193010d65 (06502757-10d6-474a-9acf-509193010d65): created successfully
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0cc9271-5873-4ac6-b79e-e456ac5aeae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:51 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (71c1ebca-b819-4e84-a9fd-901c6727253c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-afee26ea-9a2f-4adf-a5c1-abeb1806ecbb tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot 01583713-702a-49db-ae71-18a1437934b7 of volume 06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d03a2-f3e0-4ccd-8be8-e1828f969a54]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:52 devstack sudo[107231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65
Sep 11 23:22:52 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:52 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65" returned: 0 in 0.430s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:52 devstack sudo[107237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 1G
Sep 11 23:22:52 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:53 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 1G" returned: 0 in 0.487s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06502757-10d6-474a-9acf-509193010d65 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:53 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06502757-10d6-474a-9acf-509193010d65 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7
Sep 11 23:22:53 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:53 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06502757-10d6-474a-9acf-509193010d65 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7" returned: 0 in 0.303s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:53 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 is being set with open permissions: ugo+rw
Sep 11 23:22:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:53 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7
Sep 11 23:22:53 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:53 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:54 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info
Sep 11 23:22:54 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:54 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:54 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info is being set with open permissions: ugo+rw
Sep 11 23:22:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:54 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info
Sep 11 23:22:54 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:54 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.info" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3bf3af0e-0bd1-4e7c-8663-0f80d80a3846 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-01583713-702a-49db-ae71-18a1437934b7-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-01583713-702a-49db-ae71-18a1437934b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-01583713-702a-49db-ae71-18a1437934b7" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-01583713-702a-49db-ae71-18a1437934b7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot 01583713-702a-49db-ae71-18a1437934b7 of volume 06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e637964-d4ee-4843-a8c9-d6892fbd921b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:55 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7
Sep 11 23:22:55 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:56 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7" returned: 0 in 0.401s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06502757-10d6-474a-9acf-509193010d65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f8c8b-a4c0-44dc-a93d-c89911fbeaed]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:56 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65
Sep 11 23:22:56 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:56 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:56 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7
Sep 11 23:22:56 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:56 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7" returned: 0 in 0.393s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:56 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7
Sep 11 23:22:56 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:57 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65.01583713-702a-49db-ae71-18a1437934b7" returned: 0 in 0.298s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-01583713-702a-49db-ae71-18a1437934b7" released by "_delete_snapshot" :: held 1.608s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" released by "delete_snapshot" :: held 1.635s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Created reservations ['605773c4-29c2-4690-a367-42bd91141915', 'c462805f-94e5-49ac-9346-e249f1ddde9c', 'aef54668-61c9-4745-9cbb-57abf73cdc15', 'e0477636-3d98-4a3a-90c4-46166942c77f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:57 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c617f77d-76a9-4a66-95a8-af72441e34d3 tempest-ProjectMemberTests-300268079 None] Lock "cinder-01583713-702a-49db-ae71-18a1437934b7-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-06502757-10d6-474a-9acf-509193010d65-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "cinder-06502757-10d6-474a-9acf-509193010d65-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a46ca2-0edb-4993-a666-1841a24621e8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:22:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:58 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65
Sep 11 23:22:58 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:58 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:58 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65
Sep 11 23:22:58 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:58 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-06502757-10d6-474a-9acf-509193010d65" returned: 0 in 0.251s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-06502757-10d6-474a-9acf-509193010d65" released by "delete_volume" :: held 0.708s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Created reservations ['ae5e5d20-de4c-4c62-b71f-2c352b87921c', '7d03e4a3-be91-4433-8f0a-3e9aedb4ae51', 'b4123142-4d16-424d-bbdf-624fd2dadb6a', '28afdb1f-5243-4d75-9651-02acfca2f759'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:58 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:22:58 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:22:58 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:22:58 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:22:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-99488c8d-1c8f-4f64-8969-fead4bc87593 tempest-ProjectMemberTests-300268079 None] Lock "cinder-06502757-10d6-474a-9acf-509193010d65-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (c60a4102-f18b-4029-93fa-de9d78c35278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a5d2ef-870f-4793-8f55-08047283034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a5d2ef-870f-4793-8f55-08047283034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164893078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e15632-b63f-4371-ae85-f1c41c3093ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:59Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4c56f1-0e13-40d9-9667-e06d9b5cf371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4c56f1-0e13-40d9-9667-e06d9b5cf371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d62290f-a643-4017-8ffb-625425655a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d62290f-a643-4017-8ffb-625425655a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e15632-b63f-4371-ae85-f1c41c3093ca', 'volume_name': 'volume-55e15632-b63f-4371-ae85-f1c41c3093ca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85252b54-fdb0-4948-a992-ff90e31908be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85252b54-fdb0-4948-a992-ff90e31908be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2f334-0d61-418d-82a1-a1e754b24715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:22:59 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Volume 55e15632-b63f-4371-ae85-f1c41c3093ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e15632-b63f-4371-ae85-f1c41c3093ca', 'volume_size': 1}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164893078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e15632-b63f-4371-ae85-f1c41c3093ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:22:59Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Creating volume 55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:22:59 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:22:59 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:22:59 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca 1073741824
Sep 11 23:22:59 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:00 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca 1073741824" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:00 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca
Sep 11 23:23:00 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:00 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2f334-0d61-418d-82a1-a1e754b24715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e15632-b63f-4371-ae85-f1c41c3093ca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc20cb-35e4-4ef6-a5e5-9a9ba73657eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:00 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Volume volume-55e15632-b63f-4371-ae85-f1c41c3093ca (55e15632-b63f-4371-ae85-f1c41c3093ca): created successfully
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dc20cb-35e4-4ef6-a5e5-9a9ba73657eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:00 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (c60a4102-f18b-4029-93fa-de9d78c35278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:00 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-3a2aaa20-39ed-477a-aa15-7cd7c957b9d4 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:01 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot 3123e772-6dfa-4d14-8763-705cd89148aa of volume 55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:01 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda900e5-a0b7-48db-afb9-14ed4c7c8de7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:01 devstack sudo[107296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca
Sep 11 23:23:01 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:02 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Flow 'volume_create_manager' (83fb7804-62ef-4957-be85-16e83aaec8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4926a416-5195-44ba-a12e-97f0161ddd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca" returned: 0 in 0.398s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:02 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa 1G
Sep 11 23:23:02 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4926a416-5195-44ba-a12e-97f0161ddd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188614693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e60857-5a61-48f7-a98e-9ce52802f3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff315cb630743beb71af3dc1cb2a998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:02Z,use_quota=True,user_id='128d1d74f9654f969df2bb65c0808298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf0fc1d-2dbb-4748-adf1-1e0798de0435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf0fc1d-2dbb-4748-adf1-1e0798de0435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb1f805-28da-4186-9053-c6deecda742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb1f805-28da-4186-9053-c6deecda742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e60857-5a61-48f7-a98e-9ce52802f3a7', 'volume_name': 'volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c7f1a9-91e6-471f-8a14-976d0fa4f1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c7f1a9-91e6-471f-8a14-976d0fa4f1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd794d4-a963-402f-ad00-885fffbb0baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:02 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Volume f9e60857-5a61-48f7-a98e-9ce52802f3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7', 'volume_size': 1}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:02 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa 1G" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e15632-b63f-4371-ae85-f1c41c3093ca -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:02 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e15632-b63f-4371-ae85-f1c41c3093ca -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa
Sep 11 23:23:02 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:02 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55e15632-b63f-4371-ae85-f1c41c3093ca -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa" returned: 0 in 0.283s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:02 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa is being set with open permissions: ugo+rw
Sep 11 23:23:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:02 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa
Sep 11 23:23:02 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:03 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa" returned: 0 in 0.265s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:03 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info
Sep 11 23:23:03 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:03 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:03 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info is being set with open permissions: ugo+rw
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:03 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info
Sep 11 23:23:03 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:03 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.info" returned: 0 in 0.229s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.385s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188614693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e60857-5a61-48f7-a98e-9ce52802f3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff315cb630743beb71af3dc1cb2a998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:02Z,use_quota=True,user_id='128d1d74f9654f969df2bb65c0808298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Creating volume f9e60857-5a61-48f7-a98e-9ce52802f3a7 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:03 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:03 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 1073741824
Sep 11 23:23:03 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-27b93d77-4241-43df-af47-b3ed83cd6bd5 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-3123e772-6dfa-4d14-8763-705cd89148aa-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-3123e772-6dfa-4d14-8763-705cd89148aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-3123e772-6dfa-4d14-8763-705cd89148aa" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3123e772-6dfa-4d14-8763-705cd89148aa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot 3123e772-6dfa-4d14-8763-705cd89148aa of volume 55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb0c030-abf3-440a-baa3-b83412befd01]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:04 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa
Sep 11 23:23:04 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:04 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 1073741824" returned: 0 in 0.476s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:04 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7
Sep 11 23:23:04 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:04 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa" returned: 0 in 0.388s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55e15632-b63f-4371-ae85-f1c41c3093ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[657538fc-427e-469f-8e5d-e6cb72ecd98e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:04 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd794d4-a963-402f-ad00-885fffbb0baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0f329d-5e6c-420c-9a78-cb511258c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:04 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Volume volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 (f9e60857-5a61-48f7-a98e-9ce52802f3a7): created successfully
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0f329d-5e6c-420c-9a78-cb511258c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Flow 'volume_create_manager' (83fb7804-62ef-4957-be85-16e83aaec8d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:04 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a7f3dbfa-b267-4623-a757-8b691927e30d tempest-ProjectReaderTests-185130176 None] Created volume successfully.
Sep 11 23:23:04 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca
Sep 11 23:23:04 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:04 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca" returned: 0 in 0.369s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:04 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:04 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa
Sep 11 23:23:04 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:05 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa" returned: 0 in 0.327s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:05 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa
Sep 11 23:23:05 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:05 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca.3123e772-6dfa-4d14-8763-705cd89148aa" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3123e772-6dfa-4d14-8763-705cd89148aa" released by "_delete_snapshot" :: held 1.429s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" released by "delete_snapshot" :: held 1.450s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Created reservations ['f1735e7a-8364-4aa8-9c8d-15b0fa6942c5', 'be0c0481-8db8-4cac-b711-43770df9c36a', '3e7a428f-8cd4-489b-9126-c5458c4beca8', 'bb686ab4-b386-44f6-bc59-48ff9f31fb26'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Acquiring lock "cinder-f9e60857-5a61-48f7-a98e-9ce52802f3a7-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "cinder-f9e60857-5a61-48f7-a98e-9ce52802f3a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Acquiring lock "cinder-quobyte-f9e60857-5a61-48f7-a98e-9ce52802f3a7" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:05 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "cinder-quobyte-f9e60857-5a61-48f7-a98e-9ce52802f3a7" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-0ce14202-00c7-4153-bce3-b0218ff926f0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-3123e772-6dfa-4d14-8763-705cd89148aa-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9c05c-b367-4dff-a422-9b3912ef7384]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:05 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7
Sep 11 23:23:05 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:05 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7" returned: 0 in 0.383s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:05 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:05 devstack sudo[107355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7
Sep 11 23:23:05 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-55e15632-b63f-4371-ae85-f1c41c3093ca-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "cinder-55e15632-b63f-4371-ae85-f1c41c3093ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb72ab-7acd-4ca7-a9c3-15259fea88cf]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:06 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-f9e60857-5a61-48f7-a98e-9ce52802f3a7" returned: 0 in 0.288s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "cinder-quobyte-f9e60857-5a61-48f7-a98e-9ce52802f3a7" released by "delete_volume" :: held 0.712s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Created reservations ['814651e6-e94b-4ccb-93cf-7807dae13ea9', '47104093-0dc2-483b-bdb3-65b9fbc52ace', '05f7f856-9540-436f-be01-8d8330e0a75e', '4a340b67-ef63-4d98-9380-2d7fb3194dc5'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:06 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca
Sep 11 23:23:06 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:06 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:06 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:06 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca" returned: 0 in 0.364s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:06 devstack sudo[107366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca
Sep 11 23:23:06 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:06 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:06 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Deleted volume successfully.
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fe9a97b2-999e-420b-ab70-a77f9504c2c4 tempest-ProjectReaderTests-185130176 None] Lock "cinder-f9e60857-5a61-48f7-a98e-9ce52802f3a7-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:06 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-55e15632-b63f-4371-ae85-f1c41c3093ca" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-55e15632-b63f-4371-ae85-f1c41c3093ca" released by "delete_volume" :: held 0.689s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Created reservations ['8ee3e7ad-5f1b-4239-a7ff-cd3a372219c6', 'ab5eba9d-3466-4f87-88d7-81755480b68d', '6122eb73-70dc-4311-a1e6-b436b3939977', 'bbcfdb81-9a80-4d91-8c48-5cc3ed2d3876'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:06 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:07 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:07 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Flow 'volume_create_manager' (6424750b-b365-4567-9978-8c6cbb46e2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702c0fd2-bb6e-4446-beb9-281b63cb9fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702c0fd2-bb6e-4446-beb9-281b63cb9fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331407224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1674e30-2d82-45c5-b272-85b0d94c3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff315cb630743beb71af3dc1cb2a998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:07Z,use_quota=True,user_id='128d1d74f9654f969df2bb65c0808298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cea8b-0e22-4cc3-b768-16905171923c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cea8b-0e22-4cc3-b768-16905171923c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc689c61-3307-4f4a-94cd-22e4b9d295db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc689c61-3307-4f4a-94cd-22e4b9d295db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1674e30-2d82-45c5-b272-85b0d94c3db3', 'volume_name': 'volume-a1674e30-2d82-45c5-b272-85b0d94c3db3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62496c0c-7a06-4769-a64e-5401d0fae457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62496c0c-7a06-4769-a64e-5401d0fae457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d2cdb1-8673-4f82-aa17-73caed2fa35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Volume a1674e30-2d82-45c5-b272-85b0d94c3db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1674e30-2d82-45c5-b272-85b0d94c3db3', 'volume_size': 1}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1331407224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1674e30-2d82-45c5-b272-85b0d94c3db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff315cb630743beb71af3dc1cb2a998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:07Z,use_quota=True,user_id='128d1d74f9654f969df2bb65c0808298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Creating volume a1674e30-2d82-45c5-b272-85b0d94c3db3 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:07 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 1073741824
Sep 11 23:23:07 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:07 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.271s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c6f46f35-d380-438c-a641-3e519bd52f72 tempest-ProjectMemberTests-300268079 None] Lock "cinder-55e15632-b63f-4371-ae85-f1c41c3093ca-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:07 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 1073741824" returned: 0 in 0.445s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:07 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3
Sep 11 23:23:07 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (3b42e2bb-8ea6-4754-a0b3-3aa6dbdb2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5817d225-6a29-4a1b-83db-8676392dd6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5817d225-6a29-4a1b-83db-8676392dd6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879071673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44747301-a2ab-42a0-8588-1c5d657314d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:08Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3476007e-e4e0-4ef7-9340-e1bdaa0bf749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3476007e-e4e0-4ef7-9340-e1bdaa0bf749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93827dd3-4bf8-4bb0-9ced-1d87e614fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93827dd3-4bf8-4bb0-9ced-1d87e614fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44747301-a2ab-42a0-8588-1c5d657314d0', 'volume_name': 'volume-44747301-a2ab-42a0-8588-1c5d657314d0', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda54f91-fb09-414d-8f54-5b82ca646108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda54f91-fb09-414d-8f54-5b82ca646108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640f821-8e80-47d7-9e81-0736e23e9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Volume 44747301-a2ab-42a0-8588-1c5d657314d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44747301-a2ab-42a0-8588-1c5d657314d0', 'volume_size': 1}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:07 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.121s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879071673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44747301-a2ab-42a0-8588-1c5d657314d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:08Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Creating volume 44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d2cdb1-8673-4f82-aa17-73caed2fa35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1674e30-2d82-45c5-b272-85b0d94c3db3', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca8e43-041e-475e-9858-b52fa7ad4223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:07 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 1073741824
Sep 11 23:23:07 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Volume volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 (a1674e30-2d82-45c5-b272-85b0d94c3db3): created successfully
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca8e43-041e-475e-9858-b52fa7ad4223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:07 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Flow 'volume_create_manager' (6424750b-b365-4567-9978-8c6cbb46e2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:07 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-41741657-a485-495a-9f69-af023de8b102 tempest-ProjectReaderTests-185130176 None] Created volume successfully.
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Acquiring lock "cinder-a1674e30-2d82-45c5-b272-85b0d94c3db3-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "cinder-a1674e30-2d82-45c5-b272-85b0d94c3db3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Acquiring lock "cinder-quobyte-a1674e30-2d82-45c5-b272-85b0d94c3db3" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "cinder-quobyte-a1674e30-2d82-45c5-b272-85b0d94c3db3" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d713568-6615-4c93-8e61-0dc5cc3a0c93]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:08 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3
Sep 11 23:23:08 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:08 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 1073741824" returned: 0 in 0.466s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:08 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0
Sep 11 23:23:08 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:08 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3" returned: 0 in 0.370s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:08 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3
Sep 11 23:23:08 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:08 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5640f821-8e80-47d7-9e81-0736e23e9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44747301-a2ab-42a0-8588-1c5d657314d0', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6791c83b-4d3b-46c3-bf91-84e970398602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:08 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Volume volume-44747301-a2ab-42a0-8588-1c5d657314d0 (44747301-a2ab-42a0-8588-1c5d657314d0): created successfully
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6791c83b-4d3b-46c3-bf91-84e970398602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (3b42e2bb-8ea6-4754-a0b3-3aa6dbdb2161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:08 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-4807d03d-928e-48a8-82c2-83d9de745a4e tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:08 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-a1674e30-2d82-45c5-b272-85b0d94c3db3" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "cinder-quobyte-a1674e30-2d82-45c5-b272-85b0d94c3db3" released by "delete_volume" :: held 0.659s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Created reservations ['8b615e15-0147-4084-b9db-e2b3694cf9e5', '42286036-074f-4a6f-8962-a4247aa61270', 'f2fb5453-d0cb-4ca9-8fb8-b4e4dd2c97b0', 'a26a3ba9-da56-45d6-bca4-0019bc257616'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:08 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:08 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:08 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:09 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.244s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:09 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Deleted volume successfully.
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-d66db6f5-d82d-41ac-9441-940bdde91f6b tempest-ProjectReaderTests-185130176 None] Lock "cinder-a1674e30-2d82-45c5-b272-85b0d94c3db3-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot a724d7ee-e2c9-47ba-b511-bf33f69d2eee of volume 44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6071654b-68fa-4e67-9f61-e1548ea0a16f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:09 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:10 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0
Sep 11 23:23:10 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:10 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0" returned: 0 in 0.386s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:10 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee 1G
Sep 11 23:23:10 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:10 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee 1G" returned: 0 in 0.437s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:10 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44747301-a2ab-42a0-8588-1c5d657314d0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:10 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44747301-a2ab-42a0-8588-1c5d657314d0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee
Sep 11 23:23:10 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:11 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44747301-a2ab-42a0-8588-1c5d657314d0 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:11 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee is being set with open permissions: ugo+rw
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:11 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee
Sep 11 23:23:11 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:11 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:11 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info
Sep 11 23:23:11 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:11 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info" returned: 0 in 0.253s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:11 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info is being set with open permissions: ugo+rw
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:11 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info
Sep 11 23:23:11 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:11 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.info" returned: 0 in 0.238s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:11 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:11 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-dcbbafa1-50bb-45b8-b4ab-9d8b476cce03 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-a724d7ee-e2c9-47ba-b511-bf33f69d2eee-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-a724d7ee-e2c9-47ba-b511-bf33f69d2eee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-a724d7ee-e2c9-47ba-b511-bf33f69d2eee" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-a724d7ee-e2c9-47ba-b511-bf33f69d2eee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot a724d7ee-e2c9-47ba-b511-bf33f69d2eee of volume 44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a274037-9857-4623-a149-52d295ba4f22]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:12 devstack sudo[107425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee
Sep 11 23:23:12 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:12 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee" returned: 0 in 0.391s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44747301-a2ab-42a0-8588-1c5d657314d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9837ace8-bcce-413f-a802-808591c54927]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:12 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0
Sep 11 23:23:12 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:12 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0" returned: 0 in 0.394s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:12 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:13 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee
Sep 11 23:23:13 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:13 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee" returned: 0 in 0.362s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:13 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee
Sep 11 23:23:13 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:13 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0.a724d7ee-e2c9-47ba-b511-bf33f69d2eee" returned: 0 in 0.276s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-a724d7ee-e2c9-47ba-b511-bf33f69d2eee" released by "_delete_snapshot" :: held 1.537s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" released by "delete_snapshot" :: held 1.559s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Created reservations ['3fbdfa61-8d57-4f72-925e-c0e6bdd3a64a', 'cc91a7bf-a2d4-41a5-9bcd-2745de57f602', '80f4c765-3550-4bf1-bbf8-c5ed250c1ab8', 'cc67b188-3655-4cf2-a1f4-f94ee3fa11f3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:13 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:13 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6e33e38f-0dda-41ac-8fc8-4faf8405d620 tempest-ProjectMemberTests-300268079 None] Lock "cinder-a724d7ee-e2c9-47ba-b511-bf33f69d2eee-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-44747301-a2ab-42a0-8588-1c5d657314d0-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "cinder-44747301-a2ab-42a0-8588-1c5d657314d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eb79d3-7500-4bdc-8af8-4e232b5e3e88]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:14 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0
Sep 11 23:23:14 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:14 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:14 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:14 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0
Sep 11 23:23:14 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:15 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-44747301-a2ab-42a0-8588-1c5d657314d0" returned: 0 in 0.257s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-44747301-a2ab-42a0-8588-1c5d657314d0" released by "delete_volume" :: held 0.707s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Created reservations ['eeb990cf-4e6b-4649-a787-31e7b5a16865', '4d191662-2354-4d2e-b7d9-b39ee1f0e616', '6e7f2eca-0642-42eb-99a4-142618ce7a7f', 'bf97b3d6-28cd-44ea-bbf6-9b7454622901'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:15 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:15 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:15 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.315s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:15 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-e273f854-3afa-440b-a3a2-d8b51780d0c6 tempest-ProjectMemberTests-300268079 None] Lock "cinder-44747301-a2ab-42a0-8588-1c5d657314d0-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (edc4c0c7-dee1-4cca-999a-8118cd37efe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172347c-171e-4b86-b452-af58ba37a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b172347c-171e-4b86-b452-af58ba37a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699994268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27489e98-3692-4a3b-8029-41dc6af6e600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:16Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3142cd6-d4bc-4d67-a746-a0949561ced5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3142cd6-d4bc-4d67-a746-a0949561ced5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca2b8b-65e3-46fa-871d-5955f4babe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfca2b8b-65e3-46fa-871d-5955f4babe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27489e98-3692-4a3b-8029-41dc6af6e600', 'volume_name': 'volume-27489e98-3692-4a3b-8029-41dc6af6e600', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48e17ac-644f-4208-97e3-4571e412b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48e17ac-644f-4208-97e3-4571e412b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d8ad3-2a9e-456c-87d7-d8729365bc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:15 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Volume 27489e98-3692-4a3b-8029-41dc6af6e600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27489e98-3692-4a3b-8029-41dc6af6e600', 'volume_size': 1}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699994268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27489e98-3692-4a3b-8029-41dc6af6e600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:16Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Creating volume 27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:15 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:15 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:16 devstack sudo[107492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 1073741824
Sep 11 23:23:16 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:16 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 1073741824" returned: 0 in 0.459s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:16 devstack sudo[107498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600
Sep 11 23:23:16 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:16 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600" returned: 0 in 0.268s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99d8ad3-2a9e-456c-87d7-d8729365bc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27489e98-3692-4a3b-8029-41dc6af6e600', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec3449e-b291-45fc-95a0-299d4eaa786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:16 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Volume volume-27489e98-3692-4a3b-8029-41dc6af6e600 (27489e98-3692-4a3b-8029-41dc6af6e600): created successfully
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eec3449e-b291-45fc-95a0-299d4eaa786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:16 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (edc4c0c7-dee1-4cca-999a-8118cd37efe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:16 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e585a326-fdd9-4547-8438-5173b4ddb676 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Creating offline snapshot 7bf5f762-364c-4772-8d6a-89fe9d192351 of volume 27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d54e8-9469-4f4c-9f05-554a6a2a01d7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:17 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600
Sep 11 23:23:17 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:17 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600" returned: 0 in 0.392s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:17 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:17 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 1G
Sep 11 23:23:17 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:18 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 1G" returned: 0 in 0.470s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27489e98-3692-4a3b-8029-41dc6af6e600 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:18 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27489e98-3692-4a3b-8029-41dc6af6e600 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351
Sep 11 23:23:18 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:18 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27489e98-3692-4a3b-8029-41dc6af6e600 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351" returned: 0 in 0.321s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:18 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 is being set with open permissions: ugo+rw
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:18 devstack sudo[107517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351
Sep 11 23:23:18 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:18 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351" returned: 0 in 0.246s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:18 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info
Sep 11 23:23:18 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:18 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:18 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info is being set with open permissions: ugo+rw
Sep 11 23:23:18 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:18 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info
Sep 11 23:23:18 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:19 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.info" returned: 0 in 0.280s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:19 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-33bda962-ef71-47ab-9a66-c31e150800de tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-7bf5f762-364c-4772-8d6a-89fe9d192351-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-7bf5f762-364c-4772-8d6a-89fe9d192351-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-7bf5f762-364c-4772-8d6a-89fe9d192351" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7bf5f762-364c-4772-8d6a-89fe9d192351" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot 7bf5f762-364c-4772-8d6a-89fe9d192351 of volume 27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e67ecc7-a32e-40ee-9490-45a183358e27]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:20 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351
Sep 11 23:23:20 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:20 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351" returned: 0 in 0.422s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27489e98-3692-4a3b-8029-41dc6af6e600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca7dce-5d99-4775-b246-aa8c4bfd969e]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:20 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600
Sep 11 23:23:20 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:21 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600" returned: 0 in 0.495s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:21 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351
Sep 11 23:23:21 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:21 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:21 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351
Sep 11 23:23:21 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:22 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600.7bf5f762-364c-4772-8d6a-89fe9d192351" returned: 0 in 0.270s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7bf5f762-364c-4772-8d6a-89fe9d192351" released by "_delete_snapshot" :: held 1.705s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" released by "delete_snapshot" :: held 1.730s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Created reservations ['65744ba8-8446-4963-bf94-b4c741b86ce7', '66edb712-bc39-45e1-b765-201f5ae1de6b', '56b7f700-8e43-4959-8f1c-bb90f25c5366', '0b14c248-d4da-407a-8ccf-68a86e0eb99d'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-2fda3600-6964-4b19-846e-cd85b06ef9b9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-7bf5f762-364c-4772-8d6a-89fe9d192351-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-27489e98-3692-4a3b-8029-41dc6af6e600-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "cinder-27489e98-3692-4a3b-8029-41dc6af6e600-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbcb2ba-6725-4fca-95f0-2cc3bf7a3ab7]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:22 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600
Sep 11 23:23:22 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:23 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600" returned: 0 in 0.464s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:23 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600
Sep 11 23:23:23 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:23 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-27489e98-3692-4a3b-8029-41dc6af6e600" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-27489e98-3692-4a3b-8029-41dc6af6e600" released by "delete_volume" :: held 0.841s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Created reservations ['4d45c7f8-f9f7-486f-abbf-afa7c01d4ffa', 'a25e450c-f97d-4d7d-a6c4-12619331e5dd', '2107ba8f-82d5-4e9a-9d42-bf4c0c582540', '904102d3-a02b-4446-a5ce-83a422ebe80e'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:23 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:23 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:23 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:23 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:23 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-28967fac-fa63-45a6-ba43-99f0a1b2d9fc tempest-ProjectMemberTests-300268079 None] Lock "cinder-27489e98-3692-4a3b-8029-41dc6af6e600-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (371d2c90-4ffe-4e9c-a5b6-b54686c3687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d93f5e7-75a6-4c35-b43d-6527d4d4cf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d93f5e7-75a6-4c35-b43d-6527d4d4cf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161537415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757e5a1-de2e-4e38-8c6e-6aecf83dcdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:24Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c379ee8a-f476-4fd5-a904-55afef5ce80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c379ee8a-f476-4fd5-a904-55afef5ce80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3bc31e-3acb-4985-be7d-90ccbf78fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3bc31e-3acb-4985-be7d-90ccbf78fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c757e5a1-de2e-4e38-8c6e-6aecf83dcdac', 'volume_name': 'volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acc60a-4a0c-4947-8411-8e6692c05d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69acc60a-4a0c-4947-8411-8e6692c05d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1ac53-54eb-4f42-a535-130052848f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:24 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Volume c757e5a1-de2e-4e38-8c6e-6aecf83dcdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac', 'volume_size': 1}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161537415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c757e5a1-de2e-4e38-8c6e-6aecf83dcdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:24Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Creating volume c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:24 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:24 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac 1073741824
Sep 11 23:23:24 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:24 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac 1073741824" returned: 0 in 0.488s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:24 devstack sudo[107562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac
Sep 11 23:23:24 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:25 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1ac53-54eb-4f42-a535-130052848f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf747076-e5d7-487d-8dd1-f9ded0d34bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Volume volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac (c757e5a1-de2e-4e38-8c6e-6aecf83dcdac): created successfully
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf747076-e5d7-487d-8dd1-f9ded0d34bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (371d2c90-4ffe-4e9c-a5b6-b54686c3687a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-07890a6f-b8da-4ee5-8419-570ff8fb6f93 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot ddadca57-b38f-4cf9-88dd-898346568373 of volume c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[213de384-5670-45e2-942f-06722b20f9a8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:26 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac
Sep 11 23:23:26 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:26 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" returned: 0 in 0.388s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:27 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 1G
Sep 11 23:23:27 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:27 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 1G" returned: 0 in 0.466s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:27 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373
Sep 11 23:23:27 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:27 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:27 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 is being set with open permissions: ugo+rw
Sep 11 23:23:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:27 devstack sudo[107588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373
Sep 11 23:23:27 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:28 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:28 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info
Sep 11 23:23:28 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:28 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:28 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info is being set with open permissions: ugo+rw
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:28 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info
Sep 11 23:23:28 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:28 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.info" returned: 0 in 0.252s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ed7a4a3a-8eb0-49d6-a20b-3e13eafd5083 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-ddadca57-b38f-4cf9-88dd-898346568373-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-ddadca57-b38f-4cf9-88dd-898346568373-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-ddadca57-b38f-4cf9-88dd-898346568373" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-ddadca57-b38f-4cf9-88dd-898346568373" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot ddadca57-b38f-4cf9-88dd-898346568373 of volume c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[94303d18-9958-4ffa-90bd-12c1a84ee266]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:28 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373
Sep 11 23:23:28 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:29 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373" returned: 0 in 0.402s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877b6ae-3eb6-442a-9cda-d26221ccddf1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:29 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac
Sep 11 23:23:29 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:29 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" returned: 0 in 0.372s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:29 devstack sudo[107608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373
Sep 11 23:23:29 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:29 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:30 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373
Sep 11 23:23:30 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:30 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac.ddadca57-b38f-4cf9-88dd-898346568373" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-ddadca57-b38f-4cf9-88dd-898346568373" released by "_delete_snapshot" :: held 1.471s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" released by "delete_snapshot" :: held 1.495s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Created reservations ['a75005ec-42dc-41ba-a12f-c6e8c4bb0324', 'b50f9ac2-04ae-402a-a4a7-fc56826c6e0c', '88c6d7b9-baec-49d2-91c0-d6d59b25f7c8', 'bb858806-3f3a-4910-983e-341854d16833'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:30 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-759bcc99-52b1-4922-afa2-6963430696c8 tempest-ProjectMemberTests-300268079 None] Lock "cinder-ddadca57-b38f-4cf9-88dd-898346568373-delete_snapshot" released by "delete_snapshot" :: held 1.631s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "cinder-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:30 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" acquired by "delete_volume" :: waited 0.019s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6eb296-ff29-45ed-8f0b-34e37014c7ba]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:31 devstack sudo[107617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac
Sep 11 23:23:31 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:31 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" returned: 0 in 0.379s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:31 devstack sudo[107622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac
Sep 11 23:23:31 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:31 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" returned: 0 in 0.263s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac" released by "delete_volume" :: held 0.703s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Created reservations ['0932c644-f95a-4707-8c9b-8385fc615d7c', '5c9917b8-88a8-483e-9dd5-2c0be3be9e6b', '7368b91b-d92d-4efe-9d3c-b280821070c7', '4ac707a0-f094-4e78-98b2-fd8100379e49'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:31 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:31 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:31 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:32 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.260s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:32 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-a3c08bbb-c55b-47a7-b47f-76e33de66bcc tempest-ProjectMemberTests-300268079 None] Lock "cinder-c757e5a1-de2e-4e38-8c6e-6aecf83dcdac-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (2790c05b-e808-434d-a88d-34ea14ae3f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25104c52-c725-4feb-98a7-5cd9708c4aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25104c52-c725-4feb-98a7-5cd9708c4aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-100912005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b00838b-942e-4763-b292-1ba0139e65fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:33Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7292ac43-bc16-43bb-9aea-e5dcb382a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7292ac43-bc16-43bb-9aea-e5dcb382a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a12f79-3f66-4d40-928d-38270384e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a12f79-3f66-4d40-928d-38270384e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b00838b-942e-4763-b292-1ba0139e65fd', 'volume_name': 'volume-8b00838b-942e-4763-b292-1ba0139e65fd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d815e80-c96f-4218-8fa8-05d0461fc2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d815e80-c96f-4218-8fa8-05d0461fc2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911507ad-7b01-4428-92da-d656c05c4994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:32 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Volume 8b00838b-942e-4763-b292-1ba0139e65fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b00838b-942e-4763-b292-1ba0139e65fd', 'volume_size': 1}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-100912005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b00838b-942e-4763-b292-1ba0139e65fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:33Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Creating volume 8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:32 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:32 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:32 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd 1073741824
Sep 11 23:23:32 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:33 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd 1073741824" returned: 0 in 0.491s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:33 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd
Sep 11 23:23:33 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:33 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd" returned: 0 in 0.261s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (911507ad-7b01-4428-92da-d656c05c4994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b00838b-942e-4763-b292-1ba0139e65fd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebb32da-24b3-4330-a9b8-c013fbc70dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:33 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Volume volume-8b00838b-942e-4763-b292-1ba0139e65fd (8b00838b-942e-4763-b292-1ba0139e65fd): created successfully
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebb32da-24b3-4330-a9b8-c013fbc70dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:33 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (2790c05b-e808-434d-a88d-34ea14ae3f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:33 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bca65ea4-cac1-4f00-9617-d5c99204d85d tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:34 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot 435c60f7-9ece-4dde-a4d5-de45ee8a458a of volume 8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:34 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9afd0a0-46c2-4f13-9652-e9c54db166b8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:34 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:34 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd
Sep 11 23:23:34 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:35 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:35 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a 1G
Sep 11 23:23:35 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:35 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a 1G" returned: 0 in 0.432s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:35 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b00838b-942e-4763-b292-1ba0139e65fd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:35 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b00838b-942e-4763-b292-1ba0139e65fd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a
Sep 11 23:23:35 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:36 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b00838b-942e-4763-b292-1ba0139e65fd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a" returned: 0 in 0.318s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:36 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a is being set with open permissions: ugo+rw
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:36 devstack sudo[107655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a
Sep 11 23:23:36 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:36 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a" returned: 0 in 0.259s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=139,cinder:INSERT=51,cinder:UPDATE=161,cinder:DELETE=11 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:36 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info
Sep 11 23:23:36 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:36 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info" returned: 0 in 0.296s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:36 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info is being set with open permissions: ugo+rw
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:36 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info
Sep 11 23:23:36 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:36 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.info" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.073s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:36 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=132,cinder:UPDATE=183,cinder:INSERT=49,cinder:DELETE=18 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:23:36 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-41cf0043-f72a-40dc-80f8-339dd2176db0 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Flow 'volume_create_manager' (4dbc6beb-8ead-4b8d-8d7e-2ba8ac497480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5754bc-ff83-40e0-aa1e-c55620306276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5754bc-ff83-40e0-aa1e-c55620306276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1011025945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23815487-9219-4069-98f3-6c4e6761181a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368cab7c82294ca2b1294a98122092db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:38Z,use_quota=True,user_id='f7adcd40e48d4765965aec8987939756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73c753-3039-413a-a82e-66882828b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73c753-3039-413a-a82e-66882828b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e413ad-d303-4d68-ab66-14719df8e128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e413ad-d303-4d68-ab66-14719df8e128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23815487-9219-4069-98f3-6c4e6761181a', 'volume_name': 'volume-23815487-9219-4069-98f3-6c4e6761181a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c5920c-7722-43d4-98cc-b90465fb7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c5920c-7722-43d4-98cc-b90465fb7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540526ad-de06-4406-841a-6d630d4908b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:37 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Volume 23815487-9219-4069-98f3-6c4e6761181a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23815487-9219-4069-98f3-6c4e6761181a', 'volume_size': 1}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1011025945',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23815487-9219-4069-98f3-6c4e6761181a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368cab7c82294ca2b1294a98122092db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:38Z,use_quota=True,user_id='f7adcd40e48d4765965aec8987939756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Creating volume 23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:37 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:37 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:37 devstack sudo[107664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a 1073741824
Sep 11 23:23:37 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-435c60f7-9ece-4dde-a4d5-de45ee8a458a-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-435c60f7-9ece-4dde-a4d5-de45ee8a458a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-435c60f7-9ece-4dde-a4d5-de45ee8a458a" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-435c60f7-9ece-4dde-a4d5-de45ee8a458a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot 435c60f7-9ece-4dde-a4d5-de45ee8a458a of volume 8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb54f062-7d86-4075-8919-ed59bdd91a66]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:38 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a 1073741824" returned: 0 in 0.449s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:38 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a
Sep 11 23:23:38 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:38 devstack sudo[107671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:38 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:38 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540526ad-de06-4406-841a-6d630d4908b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23815487-9219-4069-98f3-6c4e6761181a', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16034451-71b1-4ab0-82d9-781f5ce65c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:38 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b00838b-942e-4763-b292-1ba0139e65fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:38 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Volume volume-23815487-9219-4069-98f3-6c4e6761181a (23815487-9219-4069-98f3-6c4e6761181a): created successfully
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16034451-71b1-4ab0-82d9-781f5ce65c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Flow 'volume_create_manager' (4dbc6beb-8ead-4b8d-8d7e-2ba8ac497480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a7b74a-c7bc-40da-ac13-4704498a0bd0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:38 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-e0d45c65-c673-4d46-8238-5a6c0c76355f tempest-SnapshotDependencyTests-1903431702 None] Created volume successfully.
Sep 11 23:23:38 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd
Sep 11 23:23:38 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Creating offline snapshot ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b of volume 23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce369b0-8305-4fde-8d1c-640f4b7efbfa]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:38 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd" returned: 0 in 0.414s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:38 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:38 devstack sudo[107685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a
Sep 11 23:23:38 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:39 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:39 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:39 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a" returned: 0 in 0.329s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:39 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a
Sep 11 23:23:39 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:39 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.381s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:39 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b 1G
Sep 11 23:23:39 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:39 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd.435c60f7-9ece-4dde-a4d5-de45ee8a458a" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-435c60f7-9ece-4dde-a4d5-de45ee8a458a" released by "_delete_snapshot" :: held 1.482s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" released by "delete_snapshot" :: held 1.507s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Created reservations ['09b0e192-6ac4-43d2-8c9c-2c614a0e93d6', 'c0b9ca25-04ce-40a9-9483-11683310c768', '208884f4-a87d-444b-b5ad-699416c0a1ca', '35ba92df-5c45-4083-8215-87adbc77fc16'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:39 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-ac3efaa7-f187-4760-8c6e-3f294eb3c78e tempest-ProjectMemberTests-300268079 None] Lock "cinder-435c60f7-9ece-4dde-a4d5-de45ee8a458a-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:39 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b 1G" returned: 0 in 0.419s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:39 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23815487-9219-4069-98f3-6c4e6761181a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:39 devstack sudo[107702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23815487-9219-4069-98f3-6c4e6761181a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:39 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23815487-9219-4069-98f3-6c4e6761181a -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.276s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:40 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b is being set with open permissions: ugo+rw
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:40 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:40 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-8b00838b-942e-4763-b292-1ba0139e65fd-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "cinder-8b00838b-942e-4763-b292-1ba0139e65fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:40 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[489f4d8c-a28a-4e0b-bc3f-8e1be5b4b75f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:40 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info
Sep 11 23:23:40 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack sudo[107710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd
Sep 11 23:23:40 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:40 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info is being set with open permissions: ugo+rw
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:40 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info
Sep 11 23:23:40 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd" returned: 0 in 0.411s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:40 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd
Sep 11 23:23:40 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:40 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.info" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:40 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-ab9eddda-6ed0-43e0-8deb-c382f6cf6d3e tempest-SnapshotDependencyTests-1903431702 None] Create snapshot completed successfully
Sep 11 23:23:40 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:40 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-8b00838b-942e-4763-b292-1ba0139e65fd" returned: 0 in 0.283s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-8b00838b-942e-4763-b292-1ba0139e65fd" released by "delete_volume" :: held 0.774s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Created reservations ['00ee3f6d-3494-4b1f-a18f-a4161bf4efbd', '24ac1bd4-efc4-4543-870a-b2df8ffd03a8', 'f8e8923e-e72b-4c37-aa2b-66ff0ae89b31', '0204c35b-2a11-4224-b7b3-c459469b790a'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:41 devstack sudo[107724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:41 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:41 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.262s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:41 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-cbde1c07-d78a-4d10-a59b-1294ae42fad2 tempest-ProjectMemberTests-300268079 None] Lock "cinder-8b00838b-942e-4763-b292-1ba0139e65fd-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Flow 'volume_create_manager' (447771a6-e5b9-45fa-9e96-eb8f19a6de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d643c2-df87-4395-b623-478ab6ba9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d643c2-df87-4395-b623-478ab6ba9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc06e43-e6bc-4f7e-b7b6-da93a6d914df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368cab7c82294ca2b1294a98122092db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:42Z,use_quota=True,user_id='f7adcd40e48d4765965aec8987939756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b091ae-cc43-48d9-8f8a-1925c41ced54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b091ae-cc43-48d9-8f8a-1925c41ced54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec90814-aae2-4c90-b70f-dcb4aeb0483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec90814-aae2-4c90-b70f-dcb4aeb0483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bc06e43-e6bc-4f7e-b7b6-da93a6d914df', 'volume_name': 'volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df', 'volume_size': 1, 'snapshot_id': 'ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b77f68-e175-4e4d-b0c7-016a16399098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b77f68-e175-4e4d-b0c7-016a16399098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a08b515-959c-498e-aacb-690d02ba2a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Volume 7bc06e43-e6bc-4f7e-b7b6-da93a6d914df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df', 'volume_size': 1, 'snapshot_id': 'ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b'}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" by "_create_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Creating volume 7bc06e43-e6bc-4f7e-b7b6-da93a6d914df from snapshot ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" by "_copy_volume_from_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] snapshot: ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b, volume: 7bc06e43-e6bc-4f7e-b7b6-da93a6d914df,  {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec398680-2464-4edc-acb7-e94e86fca1e6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (f96a45b4-ea6a-4bed-acb5-141b8eca2b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e051a743-8c0a-4743-94d7-2243e8152c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e051a743-8c0a-4743-94d7-2243e8152c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037280026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b47dec9-08f3-4c6a-9005-2dccaa42fefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:42Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e6037-9a91-40fe-a678-d00dbeb33f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f80e6037-9a91-40fe-a678-d00dbeb33f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9781b6e5-3243-486b-9062-451e55e9fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9781b6e5-3243-486b-9062-451e55e9fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b47dec9-08f3-4c6a-9005-2dccaa42fefd', 'volume_name': 'volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:41 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aba6e7e-2d5a-4aee-a8a2-f19f1169229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aba6e7e-2d5a-4aee-a8a2-f19f1169229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ae4045-12df-42c8-b8eb-77d9432e9c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:41 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Volume 3b47dec9-08f3-4c6a-9005-2dccaa42fefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd', 'volume_size': 1}
Sep 11 23:23:41 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:42 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.367s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23815487-9219-4069-98f3-6c4e6761181a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf242edb-f958-4986-a33a-03a4eb0891fb]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:42 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:42 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:42 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.389s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] will copy from snapshot at /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Creating direct copy from snapshot {{(pid=88022) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG cinder.utils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Path /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df not found in is_blk_device check {{(pid=88022) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 11 23:23:42 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:42 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df
Sep 11 23:23:42 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:46 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:46 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:46 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.583s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 11 23:23:46 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" returned: 0 in 4.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG cinder.image.image_utils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Image conversion details: src /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df {{(pid=88022) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Sep 11 23:23:46 devstack cinder-volume[88022]: INFO cinder.image.image_utils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Converted 1024.00 MB image at 237.98 MB/s
Sep 11 23:23:46 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df is being set with open permissions: ugo+rw
Sep 11 23:23:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:46 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df
Sep 11 23:23:46 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:47 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" returned: 0 in 0.238s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" released by "_copy_volume_from_snapshot" :: held 5.381s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" released by "_create_volume_from_snapshot" :: held 5.440s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.455s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.243s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037280026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b47dec9-08f3-4c6a-9005-2dccaa42fefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:42Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Creating volume 3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:47 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:47 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd 1073741824
Sep 11 23:23:47 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a08b515-959c-498e-aacb-690d02ba2a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df', 'volume_size': 1, 'snapshot_id': 'ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b'}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e32b2-3880-432b-b1cc-92d11260ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:47 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Volume volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df (7bc06e43-e6bc-4f7e-b7b6-da93a6d914df): created successfully
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (110e32b2-3880-432b-b1cc-92d11260ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Flow 'volume_create_manager' (447771a6-e5b9-45fa-9e96-eb8f19a6de63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c686fab7-1338-4aef-9e50-0d1a1ff1bd4a tempest-SnapshotDependencyTests-1903431702 None] Created volume successfully.
Sep 11 23:23:47 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd 1073741824" returned: 0 in 0.424s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:47 devstack sudo[107765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd
Sep 11 23:23:47 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:47 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" returned: 0 in 0.234s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ae4045-12df-42c8-b8eb-77d9432e9c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae0d06-6630-47fb-b741-5260ffe46c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:47 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Volume volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd (3b47dec9-08f3-4c6a-9005-2dccaa42fefd): created successfully
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70ae0d06-6630-47fb-b741-5260ffe46c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:47 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (f96a45b4-ea6a-4bed-acb5-141b8eca2b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:47 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fe2b0efb-c99e-49e4-90ee-7e3df5d0b2e6 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Deleting offline snapshot ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b of volume 23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] snapshot_file for this snap is: volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ca042-641a-4368-8b5c-097285076b46]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:48 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:48 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Creating offline snapshot 211ba24f-76d8-4bc0-af08-f01b7c3d04c1 of volume 3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fab686-2f27-4ca1-a130-8ec77f703cf1]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:48 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.377s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23815487-9219-4069-98f3-6c4e6761181a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd22d7-1f7f-4d89-ac2b-bbf667a16bd3]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:48 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:48 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd
Sep 11 23:23:48 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:48 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:48 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" returned: 0 in 0.376s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:49 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 1G
Sep 11 23:23:49 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.521s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:49 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:49 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 1G" returned: 0 in 0.394s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:49 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1
Sep 11 23:23:49 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.335s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:49 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b
Sep 11 23:23:49 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1" returned: 0 in 0.302s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 is being set with open permissions: ugo+rw
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:49 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1
Sep 11 23:23:49 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:49 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a.ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" returned: 0 in 0.268s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b" released by "_delete_snapshot" :: held 1.599s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" released by "delete_snapshot" :: held 1.619s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Created reservations ['f82d2472-8dd9-44a8-8118-adda709701e9', '8bc2ef18-dc93-4a82-9ab0-e82ffb103018', '1d1f203a-0e86-4ffb-b3be-d056352c5d61', 'b6f0c91b-2dd0-45f5-8716-64f08a2d0bb0'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:49 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:49 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Delete snapshot completed successfully.
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-8f5e0004-564b-4a29-a0f6-f18de5a5ef38 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-ec92bcb1-3b6c-43b1-a6ca-17bd4167ab1b-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:50 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info
Sep 11 23:23:50 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:50 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info" returned: 0 in 0.255s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:50 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info is being set with open permissions: ugo+rw
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:50 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info
Sep 11 23:23:50 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-23815487-9219-4069-98f3-6c4e6761181a-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-23815487-9219-4069-98f3-6c4e6761181a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:50 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.info" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3f99b7-6f00-453b-84ad-cc2d8aca9bbc]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:50 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-f4b153b2-d038-4d9c-8efd-35beb9c0083b tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:23:50 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:50 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-211ba24f-76d8-4bc0-af08-f01b7c3d04c1-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-211ba24f-76d8-4bc0-af08-f01b7c3d04c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-211ba24f-76d8-4bc0-af08-f01b7c3d04c1" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-211ba24f-76d8-4bc0-af08-f01b7c3d04c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot 211ba24f-76d8-4bc0-af08-f01b7c3d04c1 of volume 3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989fde4-e930-441b-922b-b7233396f40a]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:50 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.366s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:50 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:50 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a
Sep 11 23:23:50 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:50 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1
Sep 11 23:23:50 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:51 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-23815487-9219-4069-98f3-6c4e6761181a" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-23815487-9219-4069-98f3-6c4e6761181a" released by "delete_volume" :: held 0.686s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Created reservations ['99b4b08b-9e10-4d3c-821c-df423b0a7a9c', '16177283-fd8a-451c-9eee-0b1c29de97e4', '9c45cb88-1abd-4110-9c9f-d2397535ecbb', '87da1ce3-61c2-460b-8cf4-d0818d448ddd'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:51 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1" returned: 0 in 0.381s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c178b8-744c-49df-b230-d432311bb519]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:51 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:51 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:51 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd
Sep 11 23:23:51 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:51 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.256s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:51 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Deleted volume successfully.
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-87c573a6-c995-4a28-9cd4-69572c9b4f85 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-23815487-9219-4069-98f3-6c4e6761181a-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:51 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" returned: 0 in 0.399s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff133826-e7e7-475b-a7b4-5d0defc03268]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:51 devstack sudo[107831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1
Sep 11 23:23:51 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:51 devstack sudo[107832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df
Sep 11 23:23:51 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:51 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1" returned: 0 in 0.316s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:51 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:52 devstack sudo[107838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1
Sep 11 23:23:52 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:52 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:52 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df
Sep 11 23:23:52 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:52 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd.211ba24f-76d8-4bc0-af08-f01b7c3d04c1" returned: 0 in 0.254s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-211ba24f-76d8-4bc0-af08-f01b7c3d04c1" released by "_delete_snapshot" :: held 1.438s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" released by "delete_snapshot" :: held 1.463s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:52 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" returned: 0 in 0.263s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-quobyte-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df" released by "delete_volume" :: held 0.686s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Created reservations ['05387b16-8fcb-4c0e-8dde-4b08222757d4', '980493dd-59c7-42f8-80af-e992a8371b66', '8ed2148d-e97e-4b6b-ba48-805e9b4120f4', '53a91d60-f5b6-4f26-b0e6-01e89b791752'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-84f54924-39a8-49af-8fb5-4fdeca32fd9a tempest-ProjectMemberTests-300268079 None] Lock "cinder-211ba24f-76d8-4bc0-af08-f01b7c3d04c1-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Created reservations ['4d66ca4b-e017-42e0-afd7-68fada766689', '44fd1721-373c-4d17-ab83-99a20eee20ee', '13fd7191-f6ce-4a58-b973-149b1c12ffb4', 'ff518822-80e1-45a0-95c4-89a46cef7db8'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:52 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:52 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:52 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.240s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:52 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Deleted volume successfully.
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-bd46f059-8afe-44d5-9af9-9d0881d6f0e7 tempest-SnapshotDependencyTests-1903431702 None] Lock "cinder-7bc06e43-e6bc-4f7e-b7b6-da93a6d914df-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-3b47dec9-08f3-4c6a-9005-2dccaa42fefd-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-3b47dec9-08f3-4c6a-9005-2dccaa42fefd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:23:52 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" acquired by "delete_volume" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1543f5-97ce-4864-b129-08e3cada3dae]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:53 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd
Sep 11 23:23:53 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:53 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" returned: 0 in 0.390s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:53 devstack sudo[107855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd
Sep 11 23:23:53 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:53 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" returned: 0 in 0.271s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-3b47dec9-08f3-4c6a-9005-2dccaa42fefd" released by "delete_volume" :: held 0.726s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Created reservations ['e896e84f-95f7-44e6-988c-5e7620a0cdcc', '29db60e8-6b88-42ce-b2a0-c05a9ab24327', '8a54b04b-db27-4d77-9260-a819fff5af7e', '790f84a8-5655-4746-8912-9d13d9862af3'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:53 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:53 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:23:53 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:54 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.257s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:23:54 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-790eec31-cfbe-41a4-9006-281c458d11c9 tempest-ProjectMemberTests-300268079 None] Lock "cinder-3b47dec9-08f3-4c6a-9005-2dccaa42fefd-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (81cfd71d-342c-4295-a7b0-3e7146b188f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ddec23-522e-405a-8929-3a620ab8099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ddec23-522e-405a-8929-3a620ab8099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180275978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4ea3cd-b4bc-4721-bad6-a5682abf7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:55Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38327d69-490a-4861-b86b-2ce631cd75b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38327d69-490a-4861-b86b-2ce631cd75b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bddbc9c-63b9-4936-bec3-b2b787fa6615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bddbc9c-63b9-4936-bec3-b2b787fa6615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4ea3cd-b4bc-4721-bad6-a5682abf7050', 'volume_name': 'volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976fddcc-d49c-4007-9251-0f9a58f0c894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976fddcc-d49c-4007-9251-0f9a58f0c894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b254cb-f11c-4006-9ced-5b1d8857a843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:54 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Volume 7b4ea3cd-b4bc-4721-bad6-a5682abf7050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050', 'volume_size': 1}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-180275978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4ea3cd-b4bc-4721-bad6-a5682abf7050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d34647abff54a15a54091dba884a6ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:23:55Z,use_quota=True,user_id='60cbd24935124573bd074d497a6774a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Creating volume 7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:23:54 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:23:54 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:54 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 1073741824
Sep 11 23:23:54 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:55 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 1073741824" returned: 0 in 0.455s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:55 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050
Sep 11 23:23:55 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:55 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" returned: 0 in 0.258s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b254cb-f11c-4006-9ced-5b1d8857a843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6827c681-e9ad-42a5-bd1a-f09ef698805c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:23:55 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Volume volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 (7b4ea3cd-b4bc-4721-bad6-a5682abf7050): created successfully
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6827c681-e9ad-42a5-bd1a-f09ef698805c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:23:55 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Flow 'volume_create_manager' (81cfd71d-342c-4295-a7b0-3e7146b188f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:23:55 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-c9fb8bde-90a7-425a-bb93-77ab7afcbbb8 tempest-ProjectMemberTests-300268079 None] Created volume successfully.
Sep 11 23:23:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:23:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:23:56 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Creating offline snapshot d4270b7f-5040-4426-acb6-902138476fee of volume 7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 11 23:23:56 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdea449-cc2f-4c2f-9caf-1ef4a076872b]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:23:56 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:56 devstack sudo[107872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050
Sep 11 23:23:56 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:57 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" returned: 0 in 0.407s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee 1G {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:57 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee 1G
Sep 11 23:23:57 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:57 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee 1G" returned: 0 in 0.397s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:57 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee
Sep 11 23:23:57 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:57 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 -F qcow2 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee" returned: 0 in 0.306s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:57 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee is being set with open permissions: ugo+rw
Sep 11 23:23:57 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:57 devstack sudo[107890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee
Sep 11 23:23:58 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:58 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee" returned: 0 in 0.249s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:58 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info
Sep 11 23:23:58 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:58 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info" returned: 0 in 0.292s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:58 devstack cinder-volume[88022]: WARNING cinder.volume.drivers.remotefs [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info is being set with open permissions: ugo+rw
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:23:58 devstack sudo[107897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info
Sep 11 23:23:58 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:23:58 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.info" returned: 0 in 0.278s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:23:58 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:23:58 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-eb4a5e84-f784-4726-a075-21a0b4157be7 tempest-ProjectMemberTests-300268079 None] Create snapshot completed successfully
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-d4270b7f-5040-4426-acb6-902138476fee-delete_snapshot" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-d4270b7f-5040-4426-acb6-902138476fee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" by "delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-d4270b7f-5040-4426-acb6-902138476fee" by "_delete_snapshot" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-d4270b7f-5040-4426-acb6-902138476fee" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Deleting offline snapshot d4270b7f-5040-4426-acb6-902138476fee of volume 7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] snapshot_file for this snap is: volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611a0e9-f590-410e-a4f6-a4e92cf8561f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:00 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee
Sep 11 23:24:00 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:00 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee" returned: 0 in 0.433s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88022) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d59c63b-6524-47a6-bd1c-2dcb2f7283f6]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:00 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:00 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050
Sep 11 23:24:00 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:00 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" returned: 0 in 0.360s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:01 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee
Sep 11 23:24:01 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:01 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee" returned: 0 in 0.424s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:01 devstack sudo[107917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee
Sep 11 23:24:01 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:01 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050.d4270b7f-5040-4426-acb6-902138476fee" returned: 0 in 0.266s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-d4270b7f-5040-4426-acb6-902138476fee" released by "_delete_snapshot" :: held 1.603s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" released by "delete_snapshot" :: held 1.630s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Created reservations ['29cb8da9-42b1-4222-9da2-5c279adda0bb', 'e2811836-ae1f-441a-935d-7fde70e8e9e4', 'ece389df-b155-4081-b79e-f41d60d8cd64', '7648b0d9-36a5-419f-bebd-5c896fdb3f6c'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:01 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Delete snapshot completed successfully.
Sep 11 23:24:01 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-6820111b-8a14-4067-ad0f-5add61f80ee4 tempest-ProjectMemberTests-300268079 None] Lock "cinder-d4270b7f-5040-4426-acb6-902138476fee-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-7b4ea3cd-b4bc-4721-bad6-a5682abf7050-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-7b4ea3cd-b4bc-4721-bad6-a5682abf7050-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf7019e-6c85-49e1-bc0e-2b1b3e43ddc8]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:02 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050
Sep 11 23:24:02 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:02 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" returned: 0 in 0.399s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:02 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:02 devstack sudo[107925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050
Sep 11 23:24:02 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:03 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" returned: 0 in 0.307s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-quobyte-7b4ea3cd-b4bc-4721-bad6-a5682abf7050" released by "delete_volume" :: held 0.783s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Created reservations ['b2786686-a167-43d0-9567-69571d430418', 'fdeb4c74-d96c-4a3d-8e23-714398b266be', '07f7de32-76bd-4380-b4fd-9b9bf592ea6c', '1ec80944-1b2e-4d98-83ec-2b5f04bc779f'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:03 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:03 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:03 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.287s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:03 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Deleted volume successfully.
Sep 11 23:24:03 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-226dc596-db71-4cbe-b854-77cab88996d0 tempest-ProjectMemberTests-300268079 None] Lock "cinder-7b4ea3cd-b4bc-4721-bad6-a5682abf7050-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:13 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=63,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=7 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:24:13 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=79,cinder:DELETE=6,cinder:SELECT=62,cinder:INSERT=22 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (ee777337-835e-46d3-bb70-17ec35114791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce45ad3-5ecc-455d-8f35-c2af47ecd3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce45ad3-5ecc-455d-8f35-c2af47ecd3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287934648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3382f6-1464-4dcb-8e9e-47f9186c53ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:19Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe2f4a-f41b-48b2-9406-944430db18cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39fe2f4a-f41b-48b2-9406-944430db18cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2896d845-c3db-4bed-a3c2-807eee917e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2896d845-c3db-4bed-a3c2-807eee917e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3382f6-1464-4dcb-8e9e-47f9186c53ca', 'volume_name': 'volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcb14ed-a270-4101-888d-a6221330cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcb14ed-a270-4101-888d-a6221330cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1788923-fe79-4732-9e31-c95d447d236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:19 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Volume ee3382f6-1464-4dcb-8e9e-47f9186c53ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca', 'volume_size': 1}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-287934648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3382f6-1464-4dcb-8e9e-47f9186c53ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:19Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Creating volume ee3382f6-1464-4dcb-8e9e-47f9186c53ca {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:24:19 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:19 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca 1073741824
Sep 11 23:24:19 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:19 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca 1073741824" returned: 0 in 0.405s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:19 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:19 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca
Sep 11 23:24:19 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:20 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" returned: 0 in 0.228s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1788923-fe79-4732-9e31-c95d447d236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8359b20-6682-4d8d-ba7f-f8fb942c3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:20 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Volume volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca (ee3382f6-1464-4dcb-8e9e-47f9186c53ca): created successfully
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8359b20-6682-4d8d-ba7f-f8fb942c3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (ee777337-835e-46d3-bb70-17ec35114791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:20 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-39dc5c89-9b48-4eda-94de-7fd0ffe0226a tempest-ProjectReaderTests-1170924526 None] Created volume successfully.
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-ee3382f6-1464-4dcb-8e9e-47f9186c53ca-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-ee3382f6-1464-4dcb-8e9e-47f9186c53ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-quobyte-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" acquired by "delete_volume" :: waited 0.025s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[8051a4e8-8a0e-4cdf-9458-bcfb0a3289d0]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:20 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca
Sep 11 23:24:20 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:20 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" returned: 0 in 0.330s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:20 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:20 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca
Sep 11 23:24:20 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:21 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-ee3382f6-1464-4dcb-8e9e-47f9186c53ca" released by "delete_volume" :: held 0.611s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Created reservations ['eda0af6c-b239-4444-9374-121f2a36a32d', 'e917c341-d6f7-4b4a-b102-b1e58c30892a', '2691ea59-fe52-4c2d-b2f6-f315f5d9b80c', '6d1cb10c-af8f-489e-a8d2-a1617413ad60'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:21 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:21 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:21 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.229s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:21 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Deleted volume successfully.
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-921ac310-029f-4014-b709-0ac31e996855 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-ee3382f6-1464-4dcb-8e9e-47f9186c53ca-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:21 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (d1c98f28-1825-4ce5-b02a-ab37c01467a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef670ee-5352-4ff0-904f-63eddeadc9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef670ee-5352-4ff0-904f-63eddeadc9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529575916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b85d594-9d57-4223-ab09-10b6609be664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:22Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a44323-0ce5-4e7c-ad2f-04c8c5891667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a44323-0ce5-4e7c-ad2f-04c8c5891667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd3c3fe-6126-4a05-92e0-4be35877b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd3c3fe-6126-4a05-92e0-4be35877b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b85d594-9d57-4223-ab09-10b6609be664', 'volume_name': 'volume-7b85d594-9d57-4223-ab09-10b6609be664', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd0f69c-9bbb-47a9-8fa3-a612494e63e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd0f69c-9bbb-47a9-8fa3-a612494e63e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558a6898-dd5e-460d-97d2-12e97db4cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Volume 7b85d594-9d57-4223-ab09-10b6609be664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b85d594-9d57-4223-ab09-10b6609be664', 'volume_size': 1}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529575916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b85d594-9d57-4223-ab09-10b6609be664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:22Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Creating volume 7b85d594-9d57-4223-ab09-10b6609be664 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:24:22 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:22 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 1073741824
Sep 11 23:24:22 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:22 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 1073741824" returned: 0 in 0.387s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:22 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664
Sep 11 23:24:22 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:22 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664" returned: 0 in 0.230s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.657s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (558a6898-dd5e-460d-97d2-12e97db4cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b85d594-9d57-4223-ab09-10b6609be664', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af6bc5-be4c-437d-b2ac-eb8f42dccbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:22 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Volume volume-7b85d594-9d57-4223-ab09-10b6609be664 (7b85d594-9d57-4223-ab09-10b6609be664): created successfully
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af6bc5-be4c-437d-b2ac-eb8f42dccbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:22 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (d1c98f28-1825-4ce5-b02a-ab37c01467a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:22 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-34360ac5-09b0-4909-98fc-3c46cf4e0630 tempest-ProjectReaderTests-1170924526 None] Created volume successfully.
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-7b85d594-9d57-4223-ab09-10b6609be664-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-7b85d594-9d57-4223-ab09-10b6609be664-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-quobyte-7b85d594-9d57-4223-ab09-10b6609be664" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-7b85d594-9d57-4223-ab09-10b6609be664" acquired by "delete_volume" :: waited 0.013s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f006d-83dc-4759-9f35-cea2a37c3d42]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:23 devstack sudo[107999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664
Sep 11 23:24:23 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:23 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664" returned: 0 in 0.348s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:23 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664
Sep 11 23:24:23 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:23 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-7b85d594-9d57-4223-ab09-10b6609be664" returned: 0 in 0.242s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-7b85d594-9d57-4223-ab09-10b6609be664" released by "delete_volume" :: held 0.626s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Created reservations ['4bebdc7a-e6ee-41df-83b0-0e803c2c96e4', '22ee3611-4255-4a02-9979-6ec1c06d7332', '556e7f5f-dd04-4e2f-93cf-1f41c9a8e26e', '8eeeb536-4e7a-48bb-9cd7-d2ef1ed534a5'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:23 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:23 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:23 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:24 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.241s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:24 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Deleted volume successfully.
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-1597a54e-098f-44ae-843c-c5678110e093 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-7b85d594-9d57-4223-ab09-10b6609be664-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (bf18472b-3c3b-4e64-ae94-c50a63dc891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9da177-85af-447a-a200-082ca0078ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9da177-85af-447a-a200-082ca0078ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304868687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e6e706-44ad-4510-a7bc-f2dee8d1bc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:25Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5e4ff7-3991-495e-a427-cbde3c48f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5e4ff7-3991-495e-a427-cbde3c48f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e83dcb5-7412-402d-aaf4-25967cb40d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e83dcb5-7412-402d-aaf4-25967cb40d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07e6e706-44ad-4510-a7bc-f2dee8d1bc97', 'volume_name': 'volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf09acc-23b2-41e3-abe9-4cac839a9929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cf09acc-23b2-41e3-abe9-4cac839a9929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab71b33-a1f8-44cc-b172-ed5d2dc21596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:24 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Volume 07e6e706-44ad-4510-a7bc-f2dee8d1bc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97', 'volume_size': 1}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304868687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07e6e706-44ad-4510-a7bc-f2dee8d1bc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:25Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Creating volume 07e6e706-44ad-4510-a7bc-f2dee8d1bc97 {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:24:24 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:24:24 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:24 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 1073741824
Sep 11 23:24:24 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:25 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 1073741824" returned: 0 in 0.410s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:25 devstack sudo[108019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97
Sep 11 23:24:25 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:25 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" returned: 0 in 0.245s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab71b33-a1f8-44cc-b172-ed5d2dc21596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f998413-3529-4de8-a71b-7dbf41d34394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:25 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Volume volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 (07e6e706-44ad-4510-a7bc-f2dee8d1bc97): created successfully
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f998413-3529-4de8-a71b-7dbf41d34394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (bf18472b-3c3b-4e64-ae94-c50a63dc891a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:25 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-560a99e9-6878-4989-a96b-92f9ada70647 tempest-ProjectReaderTests-1170924526 None] Created volume successfully.
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-07e6e706-44ad-4510-a7bc-f2dee8d1bc97-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "cinder-07e6e706-44ad-4510-a7bc-f2dee8d1bc97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-quobyte-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" acquired by "delete_volume" :: waited 0.014s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[32984fb4-0842-4407-bbee-47ad81906cee]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:25 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:25 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97
Sep 11 23:24:25 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:26 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" returned: 0 in 0.367s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:26 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97
Sep 11 23:24:26 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:26 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" returned: 0 in 0.247s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-07e6e706-44ad-4510-a7bc-f2dee8d1bc97" released by "delete_volume" :: held 0.649s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Created reservations ['da169144-3761-4975-8b51-4ad87f2a3475', '0916ea73-2333-4b69-829d-fbe2ef8a25cf', '9a8331ba-b781-4acb-a10f-66d5756b1444', 'c39dfde8-c17e-4349-9422-0fc3990560d2'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:26 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:26 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:26 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:26 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Deleted volume successfully.
Sep 11 23:24:26 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-fefc5345-2f43-4460-b82b-7ed839a61bfd tempest-ProjectReaderTests-1170924526 None] Lock "cinder-07e6e706-44ad-4510-a7bc-f2dee8d1bc97-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88022) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (9ce749bf-2261-4c9e-8023-5bedf6982f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0841eb-1029-48a4-89cd-bc56a6ec28ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0841eb-1029-48a4-89cd-bc56a6ec28ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813887896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28258400-fb0e-4c86-ac55-e3bacb846a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:27Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8bb6af-54d0-49a5-9b6e-0a8001b81714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8bb6af-54d0-49a5-9b6e-0a8001b81714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23b8e56-100a-43f3-9dc5-626e5feeaaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23b8e56-100a-43f3-9dc5-626e5feeaaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28258400-fb0e-4c86-ac55-e3bacb846a2c', 'volume_name': 'volume-28258400-fb0e-4c86-ac55-e3bacb846a2c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a642f413-4b61-4ea8-9593-bf172b22349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a642f413-4b61-4ea8-9593-bf172b22349e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c69fb42-ba92-4080-adae-09c98759d5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:27 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Volume 28258400-fb0e-4c86-ac55-e3bacb846a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28258400-fb0e-4c86-ac55-e3bacb846a2c', 'volume_size': 1}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x72bdc1131640>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-11T21:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813887896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28258400-fb0e-4c86-ac55-e3bacb846a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55cf3356c47541ef915b80eb58997715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-11T21:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-11T21:24:27Z,use_quota=True,user_id='35e7e24417f448e2a61e72416c8aae45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f7bf869-e6c6-448f-a38b-bf71f19ff918),volume_type_id=2f7bf869-e6c6-448f-a38b-bf71f19ff918)}" {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.remotefs [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Creating volume 28258400-fb0e-4c86-ac55-e3bacb846a2c {{(pid=88022) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Selected osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970 as target Quobyte volume. {{(pid=88022) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 11 23:24:27 devstack cinder-volume[88022]: INFO cinder.volume.drivers.remotefs [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] casted to osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c 1073741824 {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:27 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c 1073741824
Sep 11 23:24:27 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:27 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c 1073741824" returned: 0 in 0.394s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:27 devstack sudo[108043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c
Sep 11 23:24:27 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:27 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c" returned: 0 in 0.239s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'} {{(pid=88022) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:27 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c69fb42-ba92-4080-adae-09c98759d5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28258400-fb0e-4c86-ac55-e3bacb846a2c', 'volume_size': 1}' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a15bb6-6952-4466-b059-26b0e86a53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 11 23:24:28 devstack cinder-volume[88022]: INFO cinder.volume.flows.manager.create_volume [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Volume volume-28258400-fb0e-4c86-ac55-e3bacb846a2c (28258400-fb0e-4c86-ac55-e3bacb846a2c): created successfully
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26a15bb6-6952-4466-b059-26b0e86a53bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88022) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Flow 'volume_create_manager' (9ce749bf-2261-4c9e-8023-5bedf6982f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88022) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 11 23:24:28 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-fb6864a1-fcf0-470f-979c-bcb8948017cb tempest-ProjectReaderTests-1170924526 None] Created volume successfully.
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-28258400-fb0e-4c86-ac55-e3bacb846a2c-delete_volume" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-28258400-fb0e-4c86-ac55-e3bacb846a2c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "cinder-quobyte-28258400-fb0e-4c86-ac55-e3bacb846a2c" by "delete_volume" {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-28258400-fb0e-4c86-ac55-e3bacb846a2c" acquired by "delete_volume" :: waited 0.018s {{(pid=88022) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG oslo.privsep.daemon [-] privsep: reply[db24ade6-4166-4422-9e9e-94cc3bb6b56f]: (4, 'qcow2') {{(pid=89832) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:28 devstack sudo[108046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c
Sep 11 23:24:28 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:28 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c" returned: 0 in 0.378s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:28 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c
Sep 11 23:24:28 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:28 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc/volume-28258400-fb0e-4c86-ac55-e3bacb846a2c" returned: 0 in 0.236s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:28 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-quobyte-28258400-fb0e-4c86-ac55-e3bacb846a2c" released by "delete_volume" :: held 0.652s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG cinder.quota [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Created reservations ['b096ae63-e19c-479c-8f29-54a81273b660', '6c2525f6-856c-4a90-b579-e1de534b0a51', '8ee6ffd2-5e82-4b7b-acf0-a8d25a5dd2e4', '5477ab4b-4a67-475f-a3a7-e274c6b4c5ec'] {{(pid=88022) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:29 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:29 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:29 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.250s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:29 devstack cinder-volume[88022]: INFO cinder.volume.manager [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Deleted volume successfully.
Sep 11 23:24:29 devstack cinder-volume[88022]: DEBUG cinder.coordination [None req-9fd196e1-95fe-4a31-99bb-15db58bb8639 tempest-ProjectReaderTests-1170924526 None] Lock "cinder-28258400-fb0e-4c86-ac55-e3bacb846a2c-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88022) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 11 23:24:39 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:SELECT=34,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:24:39 devstack cinder-volume[88022]: DEBUG dbcounter [-] [88022] Writing DB stats cinder:UPDATE=51,cinder:INSERT=11,cinder:DELETE=5,cinder:SELECT=22 {{(pid=88022) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970': None} {{(pid=88022) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG cinder.volume.drivers.quobyte [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74df18b1-9014-4aec-93ce-199b7c723970'] {{(pid=88022) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.lockutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88022) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 11 23:24:46 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc
Sep 11 23:24:46 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 11 23:24:46 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_concurrency.processutils [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/c33a51e7e580d3e1a2fbadc3af1cb1cc" returned: 0 in 0.256s {{(pid=88022) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG cinder.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Notifying Schedulers of capabilities ... {{(pid=88022) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG oslo_service.periodic_task [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] Running periodic task VolumeManager._thread_info {{(pid=88022) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread count: 28 {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 11 23:24:46 devstack cinder-volume[88022]: DEBUG cinder.volume.manager [None req-93069f61-011a-41d3-9fee-ce6ca2d1b48e None None] thread info: [<_MainThread(MainThread, started 126159427502208)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126159349144128)>, <Thread(Thread-3 (stat_writer), started daemon 126159312495680)>, <Thread(Rabbit-heartbeat, started daemon 126159313262336)>, <Thread(Thread-5 (_runner), started daemon 126159313365184)>, <Thread(Thread-7 (_runner), started daemon 126159311344128)>, <Thread(fd_logger, started daemon 126159307299392)>, <Thread(privsep_reader, started daemon 126159307454912)>, <Thread(tpool_thread_0, started daemon 126159303718592)>, <Thread(tpool_thread_1, started daemon 126159295325888)>, <Thread(tpool_thread_2, started daemon 126159286933184)>, <Thread(tpool_thread_3, started daemon 126159278540480)>, <Thread(tpool_thread_4, started daemon 126159270147776)>, <Thread(tpool_thread_5, started daemon 126159261755072)>, <Thread(tpool_thread_6, started daemon 126159253362368)>, <Thread(tpool_thread_7, started daemon 126159244969664)>, <Thread(tpool_thread_8, started daemon 126159236560576)>, <Thread(tpool_thread_9, started daemon 126159228151488)>, <Thread(tpool_thread_10, started daemon 126159219742400)>, <Thread(tpool_thread_11, started daemon 126159211333312)>, <Thread(tpool_thread_12, started daemon 126159202924224)>, <Thread(tpool_thread_13, started daemon 126159194515136)>, <Thread(tpool_thread_14, started daemon 126159186106048)>, <Thread(tpool_thread_15, started daemon 126159177696960)>, <Thread(tpool_thread_16, started daemon 126159169287872)>, <Thread(tpool_thread_17, started daemon 126159160878784)>, <Thread(tpool_thread_18, started daemon 126159152469696)>, <Thread(tpool_thread_19, started daemon 126159144060608)>] {{(pid=88022) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}